Skip to content

Report column size stat for primitive columns in df#7636

Draft
AdamGS wants to merge 2 commits intodevelopfrom
adamg/primitive-col-byte-size
Draft

Report column size stat for primitive columns in df#7636
AdamGS wants to merge 2 commits intodevelopfrom
adamg/primitive-col-byte-size

Conversation

@AdamGS
Copy link
Copy Markdown
Contributor

@AdamGS AdamGS commented Apr 25, 2026

No description provided.

@AdamGS
Report column size stat for primitive columns in df
afe48ee 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added changelog/performance A performance improvement ext/datafusion Relates to the DataFusion integration action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Apr 25, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 25, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 25, 2026 •
edited
Loading

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done ca6942f 1 Explore Profiling Data
Previous Runs (1)
Status Commit Job Attempt Link
🟢 Done afe48ee 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 25, 2026 •
edited
Loading

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.141x ❌

datafusion / vortex-file-compressed (1.141x ❌, 0↑ 8↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 136393734 125080602 1.09
polarsignals_q01/datafusion:vortex-file-compressed 289173742 283998375 1.02
polarsignals_q02/datafusion:vortex-file-compressed 🚨 25715511 22998797 1.12
polarsignals_q03/datafusion:vortex-file-compressed 🚨 304180295 269640578 1.13
polarsignals_q04/datafusion:vortex-file-compressed 🚨 13869291 11439022 1.21
polarsignals_q05/datafusion:vortex-file-compressed 🚨 19611645 14802491 1.32
polarsignals_q06/datafusion:vortex-file-compressed 🚨 21000250 18216020 1.15
polarsignals_q07/datafusion:vortex-file-compressed 🚨 15878453 14135448 1.12
polarsignals_q08/datafusion:vortex-file-compressed 🚨 415732103 355179792 1.17
polarsignals_q09/datafusion:vortex-file-compressed 🚨 11989216 10892754 1.10

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 25, 2026

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 25, 2026 •
edited
Loading

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.2%
Vortex (geomean): 0.997x ➖
Parquet (geomean): 1.009x ➖
Shifts: Parquet (control) +0.9% · Median polish +0.4%

datafusion / vortex-file-compressed (1.039x ➖, 0↑ 2↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5304849 4968232 1.07
fineweb_q01/datafusion:vortex-file-compressed 21090534 21367164 0.99
fineweb_q02/datafusion:vortex-file-compressed 🚨 23598647 20878041 1.13
fineweb_q03/datafusion:vortex-file-compressed 🚨 89622976 79484567 1.13
fineweb_q04/datafusion:vortex-file-compressed 230789461 231375859 1.00
fineweb_q05/datafusion:vortex-file-compressed 215235089 211896980 1.02
fineweb_q06/datafusion:vortex-file-compressed 51667472 52994097 0.97
fineweb_q07/datafusion:vortex-file-compressed 59321837 59844582 0.99
fineweb_q08/datafusion:vortex-file-compressed 22129106 20628434 1.07
datafusion / vortex-compact (1.024x ➖, 1↑ 1↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 7120943 5479883 1.30
fineweb_q01/datafusion:vortex-compact 126867817 124677592 1.02
fineweb_q02/datafusion:vortex-compact 131310866 128470093 1.02
fineweb_q03/datafusion:vortex-compact 1130283881 1030391269 1.10
fineweb_q04/datafusion:vortex-compact 1101496857 1097812662 1.00
fineweb_q05/datafusion:vortex-compact 941703058 939813965 1.00
fineweb_q06/datafusion:vortex-compact 530464475 520579068 1.02
fineweb_q07/datafusion:vortex-compact 542423789 558443690 0.97
fineweb_q08/datafusion:vortex-compact 🚀 18956744 22677524 0.84
datafusion / parquet (1.021x ➖, 0↑ 1↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 7064849 6294935 1.12
fineweb_q01/datafusion:parquet 281689278 279594076 1.01
fineweb_q02/datafusion:parquet 285513572 287295390 0.99
fineweb_q03/datafusion:parquet 286115353 280540424 1.02
fineweb_q04/datafusion:parquet 303280125 292801901 1.04
fineweb_q05/datafusion:parquet 299958666 292146768 1.03
fineweb_q06/datafusion:parquet 287450668 299789707 0.96
fineweb_q07/datafusion:parquet 282817008 276596639 1.02
fineweb_q08/datafusion:parquet 279030684 276994407 1.01
duckdb / vortex-file-compressed (0.980x ➖, 1↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3015471 3029138 1.00
fineweb_q01/duckdb:vortex-file-compressed 21370865 22280857 0.96
fineweb_q02/duckdb:vortex-file-compressed 22885620 24109163 0.95
fineweb_q03/duckdb:vortex-file-compressed 🚀 117945002 136781567 0.86
fineweb_q04/duckdb:vortex-file-compressed 223651313 223991687 1.00
fineweb_q05/duckdb:vortex-file-compressed 214122288 210015427 1.02
fineweb_q06/duckdb:vortex-file-compressed 51422767 51612165 1.00
fineweb_q07/duckdb:vortex-file-compressed 56262943 54151556 1.04
fineweb_q08/duckdb:vortex-file-compressed 22262667 22054641 1.01
duckdb / vortex-compact (0.948x ➖, 2↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 3756670 3987430 0.94
fineweb_q01/duckdb:vortex-compact 🚀 90053611 110047695 0.82
fineweb_q02/duckdb:vortex-compact 110390623 113891498 0.97
fineweb_q03/duckdb:vortex-compact 852056840 848656047 1.00
fineweb_q04/duckdb:vortex-compact 895019735 898760888 1.00
fineweb_q05/duckdb:vortex-compact 797655694 805087639 0.99
fineweb_q06/duckdb:vortex-compact 460686382 454544352 1.01
fineweb_q07/duckdb:vortex-compact 470646287 471410228 1.00
fineweb_q08/duckdb:vortex-compact 🚀 19440777 23490683 0.83
duckdb / parquet (0.998x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 30128621 31370742 0.96
fineweb_q01/duckdb:parquet 82925413 82103587 1.01
fineweb_q02/duckdb:parquet 84309192 83099009 1.01
fineweb_q03/duckdb:parquet 309194946 307209571 1.01
fineweb_q04/duckdb:parquet 436958576 437866323 1.00
fineweb_q05/duckdb:parquet 408858869 408647895 1.00
fineweb_q06/duckdb:parquet 197021792 198920738 0.99
fineweb_q07/duckdb:parquet 207893311 208083979 1.00
fineweb_q08/duckdb:parquet 28067514 28012521 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +29.9% +3.8% +25.2% +81.7% ➖ noise
0 datafusion:vortex-file-compressed +6.8% +3.8% +2.8% +49.0% ➖ noise
0 duckdb:vortex-compact -5.8% +3.8% -9.3% +104.4% ➖ noise
0 duckdb:vortex-file-compressed -0.5% +3.8% -4.1% +96.2% ➖ noise
1 datafusion:vortex-compact +1.8% +0.9% +0.9% +10.2% ➖ noise
1 datafusion:vortex-file-compressed -1.3% +0.9% -2.2% +36.1% ➖ noise
1 duckdb:vortex-compact -18.2% +0.9% -18.9% +23.3% ✅ faster
1 duckdb:vortex-file-compressed -4.1% +0.9% -4.9% +60.5% ➖ noise
2 datafusion:vortex-compact +2.2% +0.4% +1.8% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +13.0% +0.4% +12.6% +13.4% ➖ noise
2 duckdb:vortex-compact -3.1% +0.4% -3.5% +14.1% ➖ noise
2 duckdb:vortex-file-compressed -5.1% +0.4% -5.5% +10.0% ➖ noise
3 datafusion:vortex-compact +9.7% +1.3% +8.3% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +12.8% +1.3% +11.3% +51.7% ➖ noise
3 duckdb:vortex-compact +0.4% +1.3% -0.9% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -13.8% +1.3% -14.9% +31.6% ➖ noise
4 datafusion:vortex-compact +0.3% +1.7% -1.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -0.3% +1.7% -1.9% +10.0% ➖ noise
4 duckdb:vortex-compact -0.4% +1.7% -2.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.2% +1.7% -1.8% +10.0% ➖ noise
5 datafusion:vortex-compact +0.2% +1.4% -1.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +1.6% +1.4% +0.2% +10.0% ➖ noise
5 duckdb:vortex-compact -0.9% +1.4% -2.2% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +2.0% +1.4% +0.6% +10.0% ➖ noise
6 datafusion:vortex-compact +1.9% -2.5% +4.6% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -2.5% -2.5% +0.0% +10.0% ➖ noise
6 duckdb:vortex-compact +1.4% -2.5% +4.0% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.4% -2.5% +2.2% +10.0% ➖ noise
7 datafusion:vortex-compact -2.9% +1.1% -3.9% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -0.9% +1.1% -1.9% +32.7% ➖ noise
7 duckdb:vortex-compact -0.2% +1.1% -1.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +3.9% +1.1% +2.8% +15.3% ➖ noise
8 datafusion:vortex-compact -16.4% +0.5% -16.8% +33.6% ➖ noise
8 datafusion:vortex-file-compressed +7.3% +0.5% +6.8% +16.7% ➖ noise
8 duckdb:vortex-compact -17.2% +0.5% -17.6% +17.6% ✅ faster
8 duckdb:vortex-file-compressed +0.9% +0.5% +0.5% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 25, 2026

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 25, 2026 •
edited
Loading

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +5.5%
Vortex (geomean): 1.079x ➖
Parquet (geomean): 1.036x ➖
Shifts: Parquet (control) +3.6% · Median polish +5.5%

datafusion / vortex-file-compressed (1.094x ➖, 0↑ 7↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 50956280 48192985 1.06
tpch_q02/datafusion:vortex-file-compressed 22561275 22534340 1.00
tpch_q03/datafusion:vortex-file-compressed 27983308 28671691 0.98
tpch_q04/datafusion:vortex-file-compressed 21199454 20928729 1.01
tpch_q05/datafusion:vortex-file-compressed 47919667 47472378 1.01
tpch_q06/datafusion:vortex-file-compressed 12888778 12836130 1.00
tpch_q07/datafusion:vortex-file-compressed 55436713 55605769 1.00
tpch_q08/datafusion:vortex-file-compressed 40092955 39057992 1.03
tpch_q09/datafusion:vortex-file-compressed 51814094 51701747 1.00
tpch_q10/datafusion:vortex-file-compressed 42209551 39775120 1.06
tpch_q11/datafusion:vortex-file-compressed 🚨 18207430 15685820 1.16
tpch_q12/datafusion:vortex-file-compressed 28274624 25790422 1.10
tpch_q13/datafusion:vortex-file-compressed 24673441 24971676 0.99
tpch_q14/datafusion:vortex-file-compressed 🚨 22858481 16504919 1.38
tpch_q15/datafusion:vortex-file-compressed 🚨 31087283 26824744 1.16
tpch_q16/datafusion:vortex-file-compressed 19355055 19193094 1.01
tpch_q17/datafusion:vortex-file-compressed 🚨 83437876 67503104 1.24
tpch_q18/datafusion:vortex-file-compressed 🚨 107059298 78992912 1.36
tpch_q19/datafusion:vortex-file-compressed 24737238 22685140 1.09
tpch_q20/datafusion:vortex-file-compressed 🚨 41355748 30345259 1.36
tpch_q21/datafusion:vortex-file-compressed 🚨 86038399 71185970 1.21
tpch_q22/datafusion:vortex-file-compressed 12726723 12475716 1.02
datafusion / vortex-compact (1.043x ➖, 0↑ 3↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨 66792117 57653273 1.16
tpch_q02/datafusion:vortex-compact 🚨 31958723 25701650 1.24
tpch_q03/datafusion:vortex-compact 33405949 30583570 1.09
tpch_q04/datafusion:vortex-compact 24903943 24397572 1.02
tpch_q05/datafusion:vortex-compact 🚨 60049957 52214977 1.15
tpch_q06/datafusion:vortex-compact 15468373 14826474 1.04
tpch_q07/datafusion:vortex-compact 60042839 60376276 0.99
tpch_q08/datafusion:vortex-compact 44425467 44960292 0.99
tpch_q09/datafusion:vortex-compact 57618460 56928388 1.01
tpch_q10/datafusion:vortex-compact 47920665 47183374 1.02
tpch_q11/datafusion:vortex-compact 16804136 16370717 1.03
tpch_q12/datafusion:vortex-compact 34044581 33772261 1.01
tpch_q13/datafusion:vortex-compact 32733826 32594275 1.00
tpch_q14/datafusion:vortex-compact 20963899 20433812 1.03
tpch_q15/datafusion:vortex-compact 33549079 32940755 1.02
tpch_q16/datafusion:vortex-compact 23189672 22141601 1.05
tpch_q17/datafusion:vortex-compact 71840829 69197702 1.04
tpch_q18/datafusion:vortex-compact 87427262 83969602 1.04
tpch_q19/datafusion:vortex-compact 32076016 31288548 1.03
tpch_q20/datafusion:vortex-compact 36249680 34957948 1.04
tpch_q21/datafusion:vortex-compact 78864947 80020555 0.99
tpch_q22/datafusion:vortex-compact 12619695 12659815 1.00
datafusion / parquet (1.007x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 123584259 134211858 0.92
tpch_q02/datafusion:parquet 63796083 62750376 1.02
tpch_q03/datafusion:parquet 70696078 65247399 1.08
tpch_q04/datafusion:parquet 45259758 44980969 1.01
tpch_q05/datafusion:parquet 94911397 93592971 1.01
tpch_q06/datafusion:parquet 40271145 43260351 0.93
tpch_q07/datafusion:parquet 107987777 105229863 1.03
tpch_q08/datafusion:parquet 99039576 100605889 0.98
tpch_q09/datafusion:parquet 129938191 126099864 1.03
tpch_q10/datafusion:parquet 114618372 115213914 0.99
tpch_q11/datafusion:parquet 42483460 41966007 1.01
tpch_q12/datafusion:parquet 91641015 88952337 1.03
tpch_q13/datafusion:parquet 190695739 189809896 1.00
tpch_q14/datafusion:parquet 48097394 46976189 1.02
tpch_q15/datafusion:parquet 62797960 58963172 1.07
tpch_q16/datafusion:parquet 44822699 43011284 1.04
tpch_q17/datafusion:parquet 130779564 129978310 1.01
tpch_q18/datafusion:parquet 165307954 159849468 1.03
tpch_q19/datafusion:parquet 82660773 83388463 0.99
tpch_q20/datafusion:parquet 69751529 69881569 1.00
tpch_q21/datafusion:parquet 135157986 138788599 0.97
tpch_q22/datafusion:parquet 30686338 31443015 0.98
datafusion / arrow (1.190x ❌, 0↑ 12↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚨 73769364 54262189 1.36
tpch_q02/datafusion:arrow 🚨 21885269 18845081 1.16
tpch_q03/datafusion:arrow 🚨 45256262 29359704 1.54
tpch_q04/datafusion:arrow 🚨 36526344 24620335 1.48
tpch_q05/datafusion:arrow 🚨 108578626 74156556 1.46
tpch_q06/datafusion:arrow 🚨 29998921 19217401 1.56
tpch_q07/datafusion:arrow 🚨 132828428 98258306 1.35
tpch_q08/datafusion:arrow 🚨 67373335 41187506 1.64
tpch_q09/datafusion:arrow 🚨 86657872 64781803 1.34
tpch_q10/datafusion:arrow 🚨 60330663 48736403 1.24
tpch_q11/datafusion:arrow 🚨 10238604 9003453 1.14
tpch_q12/datafusion:arrow 🚨 62847689 51690654 1.22
tpch_q13/datafusion:arrow 50373066 48143169 1.05
tpch_q14/datafusion:arrow 21472682 21295104 1.01
tpch_q15/datafusion:arrow 42023905 43107055 0.97
tpch_q16/datafusion:arrow 18439161 18938168 0.97
tpch_q17/datafusion:arrow 66343815 68502959 0.97
tpch_q18/datafusion:arrow 132573279 132223357 1.00
tpch_q19/datafusion:arrow 36084354 36148116 1.00
tpch_q20/datafusion:arrow 36019330 33459462 1.08
tpch_q21/datafusion:arrow 151334589 145766162 1.04
tpch_q22/datafusion:arrow 17834731 17487365 1.02
duckdb / vortex-file-compressed (1.085x ➖, 0↑ 5↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31193404 31320325 1.00
tpch_q02/duckdb:vortex-file-compressed 🚨 27564988 24422710 1.13
tpch_q03/duckdb:vortex-file-compressed 29866078 29258810 1.02
tpch_q04/duckdb:vortex-file-compressed 29938927 29185271 1.03
tpch_q05/duckdb:vortex-file-compressed 🚨 40369019 32576739 1.24
tpch_q06/duckdb:vortex-file-compressed 11064655 10574258 1.05
tpch_q07/duckdb:vortex-file-compressed 39474319 36346925 1.09
tpch_q08/duckdb:vortex-file-compressed 39423572 38478908 1.02
tpch_q09/duckdb:vortex-file-compressed 77174929 71417324 1.08
tpch_q10/duckdb:vortex-file-compressed 36927428 34585228 1.07
tpch_q11/duckdb:vortex-file-compressed 15163148 14111485 1.07
tpch_q12/duckdb:vortex-file-compressed 22606613 22453408 1.01
tpch_q13/duckdb:vortex-file-compressed 36584047 34168478 1.07
tpch_q14/duckdb:vortex-file-compressed 21137858 22063923 0.96
tpch_q15/duckdb:vortex-file-compressed 17619937 16203109 1.09
tpch_q16/duckdb:vortex-file-compressed 29022496 28517656 1.02
tpch_q17/duckdb:vortex-file-compressed 24421825 24557007 0.99
tpch_q18/duckdb:vortex-file-compressed 50714639 48790293 1.04
tpch_q19/duckdb:vortex-file-compressed 🚨 39872887 28766832 1.39
tpch_q20/duckdb:vortex-file-compressed 34812497 33984003 1.02
tpch_q21/duckdb:vortex-file-compressed 🚨 125301655 106875554 1.17
tpch_q22/duckdb:vortex-file-compressed 🚨 24854986 16932258 1.47
duckdb / vortex-compact (1.095x ➖, 0↑ 8↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38776261 38797050 1.00
tpch_q02/duckdb:vortex-compact 🚨 43113856 35170507 1.23
tpch_q03/duckdb:vortex-compact 32367784 32150425 1.01
tpch_q04/duckdb:vortex-compact 34049512 34095763 1.00
tpch_q05/duckdb:vortex-compact 🚨 49153508 37204895 1.32
tpch_q06/duckdb:vortex-compact 14438716 15007226 0.96
tpch_q07/duckdb:vortex-compact 🚨 53949874 41625343 1.30
tpch_q08/duckdb:vortex-compact 47074456 44034200 1.07
tpch_q09/duckdb:vortex-compact 90013892 83094224 1.08
tpch_q10/duckdb:vortex-compact 40344100 38563229 1.05
tpch_q11/duckdb:vortex-compact 20042485 18655671 1.07
tpch_q12/duckdb:vortex-compact 🚨 42302583 34650521 1.22
tpch_q13/duckdb:vortex-compact 44355282 44342347 1.00
tpch_q14/duckdb:vortex-compact 🚨 36600419 29513395 1.24
tpch_q15/duckdb:vortex-compact 20119372 19697905 1.02
tpch_q16/duckdb:vortex-compact 35084218 34812882 1.01
tpch_q17/duckdb:vortex-compact 🚨 35339613 30347376 1.16
tpch_q18/duckdb:vortex-compact 53183988 49561666 1.07
tpch_q19/duckdb:vortex-compact 34376360 34253790 1.00
tpch_q20/duckdb:vortex-compact 🚨 49122562 41089917 1.20
tpch_q21/duckdb:vortex-compact 116741118 111165251 1.05
tpch_q22/duckdb:vortex-compact 🚨 22067779 19263677 1.15
duckdb / parquet (1.065x ➖, 1↑ 6↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 79160238 76217450 1.04
tpch_q02/duckdb:parquet 40413555 38913535 1.04
tpch_q03/duckdb:parquet 71661863 69860065 1.03
tpch_q04/duckdb:parquet 49690239 46615666 1.07
tpch_q05/duckdb:parquet 69242192 65877921 1.05
tpch_q06/duckdb:parquet 🚨 26555796 20305609 1.31
tpch_q07/duckdb:parquet 70290981 73696110 0.95
tpch_q08/duckdb:parquet 88098534 80119720 1.10
tpch_q09/duckdb:parquet 🚨 164632867 140218962 1.17
tpch_q10/duckdb:parquet 121415831 114940109 1.06
tpch_q11/duckdb:parquet 23181699 22328720 1.04
tpch_q12/duckdb:parquet 47223889 44928824 1.05
tpch_q13/duckdb:parquet 266510974 246763799 1.08
tpch_q14/duckdb:parquet 🚨 57492697 48828269 1.18
tpch_q15/duckdb:parquet 🚀 24284018 30227458 0.80
tpch_q16/duckdb:parquet 60637008 55851903 1.09
tpch_q17/duckdb:parquet 50971823 52515407 0.97
tpch_q18/duckdb:parquet 119857975 113996969 1.05
tpch_q19/duckdb:parquet 🚨 71806333 63931441 1.12
tpch_q20/duckdb:parquet 🚨 71154412 62897670 1.13
tpch_q21/duckdb:parquet 🚨 180395488 155224631 1.16
tpch_q22/duckdb:parquet 53984911 51796297 1.04
duckdb / duckdb (1.054x ➖, 0↑ 5↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 17202670 15828108 1.09
tpch_q02/duckdb:duckdb 12507372 12627937 0.99
tpch_q03/duckdb:duckdb 19452951 19204742 1.01
tpch_q04/duckdb:duckdb 19535863 18582534 1.05
tpch_q05/duckdb:duckdb 🚨 23529612 20281236 1.16
tpch_q06/duckdb:duckdb 5344163 5343366 1.00
tpch_q07/duckdb:duckdb 21973242 21723815 1.01
tpch_q08/duckdb:duckdb 21505721 20507487 1.05
tpch_q09/duckdb:duckdb 🚨 63837096 54987054 1.16
tpch_q10/duckdb:duckdb 43089695 44064942 0.98
tpch_q11/duckdb:duckdb 5953022 5819125 1.02
tpch_q12/duckdb:duckdb 15193008 13822262 1.10
tpch_q13/duckdb:duckdb 39930782 36407077 1.10
tpch_q14/duckdb:duckdb 🚨 19142552 16422457 1.17
tpch_q15/duckdb:duckdb 11849201 11805574 1.00
tpch_q16/duckdb:duckdb 24684171 23816473 1.04
tpch_q17/duckdb:duckdb 🚨 15795154 14073437 1.12
tpch_q18/duckdb:duckdb 39345793 39058271 1.01
tpch_q19/duckdb:duckdb 28175958 27467151 1.03
tpch_q20/duckdb:duckdb 🚨 24682735 22343954 1.10
tpch_q21/duckdb:duckdb 58535591 56293680 1.04
tpch_q22/duckdb:duckdb 24365779 24351109 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +35.9% -2.2% +39.0% +16.0% 🚨 regression
1 datafusion:vortex-compact +15.9% -2.2% +18.5% +15.9% 🚨 regression
1 datafusion:vortex-file-compressed +5.7% -2.2% +8.1% +16.6% ➖ noise
1 duckdb:duckdb +8.7% -2.2% +11.1% +14.5% ➖ noise
1 duckdb:vortex-compact -0.1% -2.2% +2.2% +15.4% ➖ noise
1 duckdb:vortex-file-compressed -0.4% -2.2% +1.8% +18.7% ➖ noise
2 datafusion:arrow +16.1% +2.8% +13.0% +11.5% 🚨 regression
2 datafusion:vortex-compact +24.3% +2.8% +21.0% +13.1% 🚨 regression
2 datafusion:vortex-file-compressed +0.1% +2.8% -2.6% +11.1% ➖ noise
2 duckdb:duckdb -1.0% +2.8% -3.6% +11.1% ➖ noise
2 duckdb:vortex-compact +22.6% +2.8% +19.3% +11.3% 🚨 regression
2 duckdb:vortex-file-compressed +12.9% +2.8% +9.8% +13.2% ➖ noise
3 datafusion:arrow +54.1% +5.4% +46.2% +11.1% 🚨 regression
3 datafusion:vortex-compact +9.2% +5.4% +3.6% +11.1% ➖ noise
3 datafusion:vortex-file-compressed -2.4% +5.4% -7.4% +11.1% ➖ noise
3 duckdb:duckdb +1.3% +5.4% -3.9% +11.1% ➖ noise
3 duckdb:vortex-compact +0.7% +5.4% -4.5% +16.6% ➖ noise
3 duckdb:vortex-file-compressed +2.1% +5.4% -3.2% +22.4% ➖ noise
4 datafusion:arrow +48.4% +3.6% +43.3% +11.1% 🚨 regression
4 datafusion:vortex-compact +2.1% +3.6% -1.4% +11.1% ➖ noise
4 datafusion:vortex-file-compressed +1.3% +3.6% -2.2% +11.1% ➖ noise
4 duckdb:duckdb +5.1% +3.6% +1.5% +11.1% ➖ noise
4 duckdb:vortex-compact -0.1% +3.6% -3.6% +11.1% ➖ noise
4 duckdb:vortex-file-compressed +2.6% +3.6% -0.9% +11.1% ➖ noise
5 datafusion:arrow +46.4% +3.2% +41.8% +11.1% 🚨 regression
5 datafusion:vortex-compact +15.0% +3.2% +11.4% +15.4% ➖ noise
5 datafusion:vortex-file-compressed +0.9% +3.2% -2.2% +11.1% ➖ noise
5 duckdb:duckdb +16.0% +3.2% +12.4% +11.1% 🚨 regression
5 duckdb:vortex-compact +32.1% +3.2% +28.0% +20.5% 🚨 regression
5 duckdb:vortex-file-compressed +23.9% +3.2% +20.0% +19.5% 🚨 regression
6 datafusion:arrow +56.1% +10.3% +41.5% +14.4% 🚨 regression
6 datafusion:vortex-compact +4.3% +10.3% -5.4% +15.5% ➖ noise
6 datafusion:vortex-file-compressed +0.4% +10.3% -9.0% +15.2% ➖ noise
6 duckdb:duckdb +0.0% +10.3% -9.4% +17.0% ➖ noise
6 duckdb:vortex-compact -3.8% +10.3% -12.8% +18.0% ➖ noise
6 duckdb:vortex-file-compressed +4.6% +10.3% -5.2% +16.2% ➖ noise
7 datafusion:arrow +35.2% -1.1% +36.6% +11.7% 🚨 regression
7 datafusion:vortex-compact -0.6% -1.1% +0.5% +11.1% ➖ noise
7 datafusion:vortex-file-compressed -0.3% -1.1% +0.8% +11.1% ➖ noise
7 duckdb:duckdb +1.1% -1.1% +2.2% +11.1% ➖ noise
7 duckdb:vortex-compact +29.6% -1.1% +31.0% +15.2% 🚨 regression
7 duckdb:vortex-file-compressed +8.6% -1.1% +9.8% +11.1% ➖ noise
8 datafusion:arrow +63.6% +4.0% +57.2% +11.1% 🚨 regression
8 datafusion:vortex-compact -1.2% +4.0% -5.0% +11.1% ➖ noise
8 datafusion:vortex-file-compressed +2.6% +4.0% -1.3% +11.1% ➖ noise
8 duckdb:duckdb +4.9% +4.0% +0.8% +11.1% ➖ noise
8 duckdb:vortex-compact +6.9% +4.0% +2.8% +11.1% ➖ noise
8 duckdb:vortex-file-compressed +2.5% +4.0% -1.5% +11.1% ➖ noise
9 datafusion:arrow +33.8% +10.0% +21.6% +15.9% 🚨 regression
9 datafusion:vortex-compact +1.2% +10.0% -8.0% +11.1% ➖ noise
9 datafusion:vortex-file-compressed +0.2% +10.0% -8.9% +11.1% ➖ noise
9 duckdb:duckdb +16.1% +10.0% +5.5% +13.0% ➖ noise
9 duckdb:vortex-compact +8.3% +10.0% -1.5% +18.2% ➖ noise
9 duckdb:vortex-file-compressed +8.1% +10.0% -1.8% +11.1% ➖ noise
10 datafusion:arrow +23.8% +2.5% +20.8% +13.0% 🚨 regression
10 datafusion:vortex-compact +1.6% +2.5% -0.9% +11.1% ➖ noise
10 datafusion:vortex-file-compressed +6.1% +2.5% +3.5% +11.6% ➖ noise
10 duckdb:duckdb -2.2% +2.5% -4.6% +12.9% ➖ noise
10 duckdb:vortex-compact +4.6% +2.5% +2.1% +11.1% ➖ noise
10 duckdb:vortex-file-compressed +6.8% +2.5% +4.2% +11.6% ➖ noise
11 datafusion:arrow +13.7% +2.5% +10.9% +11.1% ➖ noise
11 datafusion:vortex-compact +2.6% +2.5% +0.1% +11.1% ➖ noise
11 datafusion:vortex-file-compressed +16.1% +2.5% +13.2% +11.1% 🚨 regression
11 duckdb:duckdb +2.3% +2.5% -0.2% +12.0% ➖ noise
11 duckdb:vortex-compact +7.4% +2.5% +4.8% +11.1% ➖ noise
11 duckdb:vortex-file-compressed +7.5% +2.5% +4.8% +11.1% ➖ noise
12 datafusion:arrow +21.6% +4.1% +16.8% +18.2% ➖ noise
12 datafusion:vortex-compact +0.8% +4.1% -3.1% +11.1% ➖ noise
12 datafusion:vortex-file-compressed +9.6% +4.1% +5.4% +11.1% ➖ noise
12 duckdb:duckdb +9.9% +4.1% +5.6% +11.1% ➖ noise
12 duckdb:vortex-compact +22.1% +4.1% +17.3% +12.2% 🚨 regression
12 duckdb:vortex-file-compressed +0.7% +4.1% -3.2% +11.1% ➖ noise
13 datafusion:arrow +4.6% +4.2% +0.4% +11.1% ➖ noise
13 datafusion:vortex-compact +0.4% +4.2% -3.6% +11.1% ➖ noise
13 datafusion:vortex-file-compressed -1.2% +4.2% -5.1% +11.1% ➖ noise
13 duckdb:duckdb +9.7% +4.2% +5.3% +11.4% ➖ noise
13 duckdb:vortex-compact +0.0% +4.2% -4.0% +11.1% ➖ noise
13 duckdb:vortex-file-compressed +7.1% +4.2% +2.8% +11.1% ➖ noise
14 datafusion:arrow +0.8% +9.8% -8.2% +13.3% ➖ noise
14 datafusion:vortex-compact +2.6% +9.8% -6.6% +11.1% ➖ noise
14 datafusion:vortex-file-compressed +38.5% +9.8% +26.1% +14.2% 🚨 regression
14 duckdb:duckdb +16.6% +9.8% +6.2% +20.9% ➖ noise
14 duckdb:vortex-compact +24.0% +9.8% +12.9% +15.5% ➖ noise
14 duckdb:vortex-file-compressed -4.2% +9.8% -12.7% +14.6% ✅ faster
15 datafusion:arrow -2.5% -7.5% +5.4% +11.1% ➖ noise
15 datafusion:vortex-compact +1.8% -7.5% +10.1% +13.7% ➖ noise
15 datafusion:vortex-file-compressed +15.9% -7.5% +25.3% +14.6% 🚨 regression
15 duckdb:duckdb +0.4% -7.5% +8.5% +12.6% ➖ noise
15 duckdb:vortex-compact +2.1% -7.5% +10.4% +24.8% ➖ noise
15 duckdb:vortex-file-compressed +8.7% -7.5% +17.6% +15.0% 🚨 regression
16 datafusion:arrow -2.6% +6.4% -8.5% +11.1% ➖ noise
16 datafusion:vortex-compact +4.7% +6.4% -1.5% +11.1% ➖ noise
16 datafusion:vortex-file-compressed +0.8% +6.4% -5.2% +11.1% ➖ noise
16 duckdb:duckdb +3.6% +6.4% -2.6% +11.1% ➖ noise
16 duckdb:vortex-compact +0.8% +6.4% -5.3% +11.1% ➖ noise
16 duckdb:vortex-file-compressed +1.8% +6.4% -4.3% +11.1% ➖ noise
17 datafusion:arrow -3.2% -1.2% -2.0% +11.1% ➖ noise
17 datafusion:vortex-compact +3.8% -1.2% +5.1% +13.2% ➖ noise
17 datafusion:vortex-file-compressed +23.6% -1.2% +25.1% +15.7% 🚨 regression
17 duckdb:duckdb +12.2% -1.2% +13.6% +11.1% 🚨 regression
17 duckdb:vortex-compact +16.5% -1.2% +17.8% +17.3% 🚨 regression
17 duckdb:vortex-file-compressed -0.6% -1.2% +0.6% +11.3% ➖ noise
18 datafusion:arrow +0.3% +4.3% -3.8% +11.1% ➖ noise
18 datafusion:vortex-compact +4.1% +4.3% -0.2% +11.1% ➖ noise
18 datafusion:vortex-file-compressed +35.5% +4.3% +30.0% +13.4% 🚨 regression
18 duckdb:duckdb +0.7% +4.3% -3.4% +11.1% ➖ noise
18 duckdb:vortex-compact +7.3% +4.3% +2.9% +11.1% ➖ noise
18 duckdb:vortex-file-compressed +3.9% +4.3% -0.3% +11.1% ➖ noise
19 datafusion:arrow -0.2% +5.5% -5.4% +14.0% ➖ noise
19 datafusion:vortex-compact +2.5% +5.5% -2.8% +12.1% ➖ noise
19 datafusion:vortex-file-compressed +9.0% +5.5% +3.3% +12.9% ➖ noise
19 duckdb:duckdb +2.6% +5.5% -2.8% +15.2% ➖ noise
19 duckdb:vortex-compact +0.4% +5.5% -4.9% +13.6% ➖ noise
19 duckdb:vortex-file-compressed +38.6% +5.5% +31.4% +18.1% 🚨 regression
20 datafusion:arrow +7.7% +6.3% +1.3% +11.4% ➖ noise
20 datafusion:vortex-compact +3.7% +6.3% -2.4% +11.1% ➖ noise
20 datafusion:vortex-file-compressed +36.3% +6.3% +28.3% +11.4% 🚨 regression
20 duckdb:duckdb +10.5% +6.3% +4.0% +11.1% ➖ noise
20 duckdb:vortex-compact +19.5% +6.3% +12.5% +14.6% ➖ noise
20 duckdb:vortex-file-compressed +2.4% +6.3% -3.6% +11.1% ➖ noise
21 datafusion:arrow +3.8% +6.4% -2.4% +11.1% ➖ noise
21 datafusion:vortex-compact -1.4% +6.4% -7.4% +11.1% ➖ noise
21 datafusion:vortex-file-compressed +20.9% +6.4% +13.6% +14.1% ➖ noise
21 duckdb:duckdb +4.0% +6.4% -2.3% +11.1% ➖ noise
21 duckdb:vortex-compact +5.0% +6.4% -1.3% +11.1% ➖ noise
21 duckdb:vortex-file-compressed +17.2% +6.4% +10.2% +20.1% ➖ noise
22 datafusion:arrow +2.0% +0.9% +1.1% +11.1% ➖ noise
22 datafusion:vortex-compact -0.3% +0.9% -1.2% +11.1% ➖ noise
22 datafusion:vortex-file-compressed +2.0% +0.9% +1.1% +11.1% ➖ noise
22 duckdb:duckdb +0.1% +0.9% -0.8% +11.1% ➖ noise
22 duckdb:vortex-compact +14.6% +0.9% +13.6% +11.1% 🚨 regression
22 duckdb:vortex-file-compressed +46.8% +0.9% +45.5% +11.1% 🚨 regression

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 25, 2026 •
edited
Loading

File Sizes: TPC-H SF=1 on NVME

File Size Changes (195 files changed, -98.4% overall, 0↑ 195↓)
File Scale Format Base HEAD Change %
orders_14.vortex 100 vortex-file-compressed 180.18 MB 0 B 180.18 MB -100.0%
lineitem_72.vortex 100 vortex-file-compressed 147.99 MB 0 B 147.99 MB -100.0%
part_12.vortex 100 vortex-file-compressed 28.43 MB 0 B 28.43 MB -100.0%
lineitem_92.vortex 100 vortex-file-compressed 148.08 MB 0 B 148.08 MB -100.0%
part_0.vortex 100 vortex-file-compressed 28.45 MB 0 B 28.45 MB -100.0%
lineitem_119.vortex 100 vortex-file-compressed 148.33 MB 0 B 148.33 MB -100.0%
partsupp_16.vortex 100 vortex-file-compressed 191.25 MB 0 B 191.25 MB -100.0%
partsupp_10.vortex 100 vortex-file-compressed 191.59 MB 0 B 191.59 MB -100.0%
lineitem_77.vortex 100 vortex-file-compressed 148.24 MB 0 B 148.24 MB -100.0%
orders_3.vortex 100 vortex-file-compressed 180.12 MB 0 B 180.12 MB -100.0%
lineitem_81.vortex 100 vortex-file-compressed 147.75 MB 0 B 147.75 MB -100.0%
lineitem_111.vortex 100 vortex-file-compressed 147.77 MB 0 B 147.77 MB -100.0%
lineitem_47.vortex 100 vortex-file-compressed 148.26 MB 0 B 148.26 MB -100.0%
part_18.vortex 100 vortex-file-compressed 28.51 MB 0 B 28.51 MB -100.0%
lineitem_2.vortex 100 vortex-file-compressed 148.59 MB 0 B 148.59 MB -100.0%
orders_19.vortex 100 vortex-file-compressed 180.04 MB 0 B 180.04 MB -100.0%
lineitem_12.vortex 100 vortex-file-compressed 148.19 MB 0 B 148.19 MB -100.0%
customer_3.vortex 100 vortex-file-compressed 261.80 MB 0 B 261.80 MB -100.0%
lineitem_43.vortex 100 vortex-file-compressed 147.84 MB 0 B 147.84 MB -100.0%
lineitem_52.vortex 100 vortex-file-compressed 146.97 MB 0 B 146.97 MB -100.0%
lineitem_97.vortex 100 vortex-file-compressed 148.10 MB 0 B 148.10 MB -100.0%
part_4.vortex 100 vortex-file-compressed 28.42 MB 0 B 28.42 MB -100.0%
lineitem_54.vortex 100 vortex-file-compressed 149.12 MB 0 B 149.12 MB -100.0%
orders_16.vortex 100 vortex-file-compressed 179.88 MB 0 B 179.88 MB -100.0%
lineitem_41.vortex 100 vortex-file-compressed 146.66 MB 0 B 146.66 MB -100.0%
lineitem_76.vortex 100 vortex-file-compressed 147.35 MB 0 B 147.35 MB -100.0%
orders_11.vortex 100 vortex-file-compressed 180.08 MB 0 B 180.08 MB -100.0%
lineitem_88.vortex 100 vortex-file-compressed 148.71 MB 0 B 148.71 MB -100.0%
lineitem_17.vortex 100 vortex-file-compressed 148.59 MB 0 B 148.59 MB -100.0%
orders_4.vortex 100 vortex-file-compressed 180.39 MB 0 B 180.39 MB -100.0%
lineitem_105.vortex 100 vortex-file-compressed 147.47 MB 0 B 147.47 MB -100.0%
lineitem_0.vortex 100 vortex-file-compressed 148.68 MB 0 B 148.68 MB -100.0%
lineitem_9.vortex 100 vortex-file-compressed 148.87 MB 0 B 148.87 MB -100.0%
lineitem_87.vortex 100 vortex-file-compressed 147.46 MB 0 B 147.46 MB -100.0%
lineitem_70.vortex 100 vortex-file-compressed 147.89 MB 0 B 147.89 MB -100.0%
lineitem_58.vortex 100 vortex-file-compressed 148.72 MB 0 B 148.72 MB -100.0%
orders_13.vortex 100 vortex-file-compressed 179.83 MB 0 B 179.83 MB -100.0%
lineitem_26.vortex 100 vortex-file-compressed 148.11 MB 0 B 148.11 MB -100.0%
lineitem_24.vortex 100 vortex-file-compressed 147.50 MB 0 B 147.50 MB -100.0%
partsupp_6.vortex 100 vortex-file-compressed 191.38 MB 0 B 191.38 MB -100.0%
part_9.vortex 100 vortex-file-compressed 28.41 MB 0 B 28.41 MB -100.0%
partsupp_17.vortex 100 vortex-file-compressed 191.49 MB 0 B 191.49 MB -100.0%
lineitem_19.vortex 100 vortex-file-compressed 148.77 MB 0 B 148.77 MB -100.0%
lineitem_66.vortex 100 vortex-file-compressed 148.09 MB 0 B 148.09 MB -100.0%
partsupp_7.vortex 100 vortex-file-compressed 191.61 MB 0 B 191.61 MB -100.0%
lineitem_65.vortex 100 vortex-file-compressed 147.57 MB 0 B 147.57 MB -100.0%
part_14.vortex 100 vortex-file-compressed 28.46 MB 0 B 28.46 MB -100.0%
lineitem_11.vortex 100 vortex-file-compressed 148.62 MB 0 B 148.62 MB -100.0%
lineitem_101.vortex 100 vortex-file-compressed 148.35 MB 0 B 148.35 MB -100.0%
partsupp_4.vortex 100 vortex-file-compressed 191.40 MB 0 B 191.40 MB -100.0%
lineitem_32.vortex 100 vortex-file-compressed 148.90 MB 0 B 148.90 MB -100.0%
lineitem_8.vortex 100 vortex-file-compressed 148.56 MB 0 B 148.56 MB -100.0%
lineitem_79.vortex 100 vortex-file-compressed 148.43 MB 0 B 148.43 MB -100.0%
lineitem_38.vortex 100 vortex-file-compressed 149.09 MB 0 B 149.09 MB -100.0%
customer_2.vortex 100 vortex-file-compressed 261.69 MB 0 B 261.69 MB -100.0%
part_6.vortex 100 vortex-file-compressed 28.44 MB 0 B 28.44 MB -100.0%
lineitem_110.vortex 100 vortex-file-compressed 148.41 MB 0 B 148.41 MB -100.0%
part_13.vortex 100 vortex-file-compressed 28.44 MB 0 B 28.44 MB -100.0%
lineitem_100.vortex 100 vortex-file-compressed 148.11 MB 0 B 148.11 MB -100.0%
lineitem_106.vortex 100 vortex-file-compressed 148.07 MB 0 B 148.07 MB -100.0%
lineitem_60.vortex 100 vortex-file-compressed 148.62 MB 0 B 148.62 MB -100.0%
lineitem_15.vortex 100 vortex-file-compressed 147.63 MB 0 B 147.63 MB -100.0%
lineitem_61.vortex 100 vortex-file-compressed 147.73 MB 0 B 147.73 MB -100.0%
lineitem_96.vortex 100 vortex-file-compressed 148.03 MB 0 B 148.03 MB -100.0%
orders_0.vortex 100 vortex-file-compressed 180.00 MB 0 B 180.00 MB -100.0%
lineitem_25.vortex 100 vortex-file-compressed 148.52 MB 0 B 148.52 MB -100.0%
lineitem_83.vortex 100 vortex-file-compressed 148.68 MB 0 B 148.68 MB -100.0%
lineitem_78.vortex 100 vortex-file-compressed 147.35 MB 0 B 147.35 MB -100.0%
lineitem_90.vortex 100 vortex-file-compressed 147.82 MB 0 B 147.82 MB -100.0%
partsupp_14.vortex 100 vortex-file-compressed 191.62 MB 0 B 191.62 MB -100.0%
lineitem_28.vortex 100 vortex-file-compressed 148.66 MB 0 B 148.66 MB -100.0%
lineitem_94.vortex 100 vortex-file-compressed 148.40 MB 0 B 148.40 MB -100.0%
orders_22.vortex 100 vortex-file-compressed 180.04 MB 0 B 180.04 MB -100.0%
orders_12.vortex 100 vortex-file-compressed 180.32 MB 0 B 180.32 MB -100.0%
partsupp_0.vortex 100 vortex-file-compressed 191.37 MB 0 B 191.37 MB -100.0%
part_11.vortex 100 vortex-file-compressed 28.45 MB 0 B 28.45 MB -100.0%
duckdb.db 100 vortex-file-compressed 268.00 KB 0 B 268.00 KB -100.0%
lineitem_30.vortex 100 vortex-file-compressed 147.46 MB 0 B 147.46 MB -100.0%
part_10.vortex 100 vortex-file-compressed 28.43 MB 0 B 28.43 MB -100.0%
partsupp_2.vortex 100 vortex-file-compressed 191.39 MB 0 B 191.39 MB -100.0%
orders_24.vortex 100 vortex-file-compressed 179.56 MB 0 B 179.56 MB -100.0%
lineitem_35.vortex 100 vortex-file-compressed 148.35 MB 0 B 148.35 MB -100.0%
lineitem_86.vortex 100 vortex-file-compressed 147.62 MB 0 B 147.62 MB -100.0%
lineitem_13.vortex 100 vortex-file-compressed 148.26 MB 0 B 148.26 MB -100.0%
lineitem_112.vortex 100 vortex-file-compressed 147.42 MB 0 B 147.42 MB -100.0%
orders_15.vortex 100 vortex-file-compressed 180.19 MB 0 B 180.19 MB -100.0%
orders_27.vortex 100 vortex-file-compressed 179.78 MB 0 B 179.78 MB -100.0%
partsupp_11.vortex 100 vortex-file-compressed 191.43 MB 0 B 191.43 MB -100.0%
lineitem_80.vortex 100 vortex-file-compressed 147.55 MB 0 B 147.55 MB -100.0%
customer_1.vortex 100 vortex-file-compressed 261.77 MB 0 B 261.77 MB -100.0%
lineitem_40.vortex 100 vortex-file-compressed 147.97 MB 0 B 147.97 MB -100.0%
lineitem_55.vortex 100 vortex-file-compressed 148.16 MB 0 B 148.16 MB -100.0%
lineitem_63.vortex 100 vortex-file-compressed 148.65 MB 0 B 148.65 MB -100.0%
lineitem_99.vortex 100 vortex-file-compressed 147.26 MB 0 B 147.26 MB -100.0%
lineitem_108.vortex 100 vortex-file-compressed 147.29 MB 0 B 147.29 MB -100.0%
lineitem_46.vortex 100 vortex-file-compressed 147.77 MB 0 B 147.77 MB -100.0%
orders_21.vortex 100 vortex-file-compressed 179.89 MB 0 B 179.89 MB -100.0%
orders_25.vortex 100 vortex-file-compressed 179.82 MB 0 B 179.82 MB -100.0%
partsupp_9.vortex 100 vortex-file-compressed 191.50 MB 0 B 191.50 MB -100.0%
lineitem_29.vortex 100 vortex-file-compressed 148.75 MB 0 B 148.75 MB -100.0%
lineitem_73.vortex 100 vortex-file-compressed 148.32 MB 0 B 148.32 MB -100.0%
lineitem_16.vortex 100 vortex-file-compressed 148.03 MB 0 B 148.03 MB -100.0%
part_8.vortex 100 vortex-file-compressed 28.43 MB 0 B 28.43 MB -100.0%
lineitem_59.vortex 100 vortex-file-compressed 148.42 MB 0 B 148.42 MB -100.0%
lineitem_114.vortex 100 vortex-file-compressed 147.46 MB 0 B 147.46 MB -100.0%
lineitem_51.vortex 100 vortex-file-compressed 148.42 MB 0 B 148.42 MB -100.0%
lineitem_44.vortex 100 vortex-file-compressed 147.91 MB 0 B 147.91 MB -100.0%
lineitem_104.vortex 100 vortex-file-compressed 148.59 MB 0 B 148.59 MB -100.0%
orders_2.vortex 100 vortex-file-compressed 180.35 MB 0 B 180.35 MB -100.0%
lineitem_102.vortex 100 vortex-file-compressed 148.14 MB 0 B 148.14 MB -100.0%
orders_6.vortex 100 vortex-file-compressed 179.80 MB 0 B 179.80 MB -100.0%
part_2.vortex 100 vortex-file-compressed 28.46 MB 0 B 28.46 MB -100.0%
partsupp_12.vortex 100 vortex-file-compressed 191.50 MB 0 B 191.50 MB -100.0%
part_1.vortex 100 vortex-file-compressed 28.49 MB 0 B 28.49 MB -100.0%
lineitem_49.vortex 100 vortex-file-compressed 148.47 MB 0 B 148.47 MB -100.0%
lineitem_107.vortex 100 vortex-file-compressed 148.04 MB 0 B 148.04 MB -100.0%
part_16.vortex 100 vortex-file-compressed 28.42 MB 0 B 28.42 MB -100.0%
part_5.vortex 100 vortex-file-compressed 28.38 MB 0 B 28.38 MB -100.0%
lineitem_4.vortex 100 vortex-file-compressed 147.27 MB 0 B 147.27 MB -100.0%
lineitem_117.vortex 100 vortex-file-compressed 148.24 MB 0 B 148.24 MB -100.0%
lineitem_48.vortex 100 vortex-file-compressed 148.23 MB 0 B 148.23 MB -100.0%
lineitem_115.vortex 100 vortex-file-compressed 147.64 MB 0 B 147.64 MB -100.0%
orders_26.vortex 100 vortex-file-compressed 179.99 MB 0 B 179.99 MB -100.0%
orders_23.vortex 100 vortex-file-compressed 179.94 MB 0 B 179.94 MB -100.0%
partsupp_13.vortex 100 vortex-file-compressed 191.35 MB 0 B 191.35 MB -100.0%
lineitem_53.vortex 100 vortex-file-compressed 148.23 MB 0 B 148.23 MB -100.0%
lineitem_67.vortex 100 vortex-file-compressed 148.84 MB 0 B 148.84 MB -100.0%
partsupp_3.vortex 100 vortex-file-compressed 191.37 MB 0 B 191.37 MB -100.0%
lineitem_89.vortex 100 vortex-file-compressed 148.03 MB 0 B 148.03 MB -100.0%
lineitem_23.vortex 100 vortex-file-compressed 148.19 MB 0 B 148.19 MB -100.0%
lineitem_93.vortex 100 vortex-file-compressed 147.77 MB 0 B 147.77 MB -100.0%
lineitem_116.vortex 100 vortex-file-compressed 148.20 MB 0 B 148.20 MB -100.0%
orders_7.vortex 100 vortex-file-compressed 180.12 MB 0 B 180.12 MB -100.0%
lineitem_84.vortex 100 vortex-file-compressed 147.94 MB 0 B 147.94 MB -100.0%
lineitem_36.vortex 100 vortex-file-compressed 147.64 MB 0 B 147.64 MB -100.0%
lineitem_18.vortex 100 vortex-file-compressed 147.55 MB 0 B 147.55 MB -100.0%
lineitem_21.vortex 100 vortex-file-compressed 148.33 MB 0 B 148.33 MB -100.0%
lineitem_22.vortex 100 vortex-file-compressed 147.32 MB 0 B 147.32 MB -100.0%
lineitem_3.vortex 100 vortex-file-compressed 148.16 MB 0 B 148.16 MB -100.0%
lineitem_68.vortex 100 vortex-file-compressed 148.03 MB 0 B 148.03 MB -100.0%
orders_10.vortex 100 vortex-file-compressed 180.14 MB 0 B 180.14 MB -100.0%
lineitem_39.vortex 100 vortex-file-compressed 147.38 MB 0 B 147.38 MB -100.0%
lineitem_37.vortex 100 vortex-file-compressed 147.47 MB 0 B 147.47 MB -100.0%
orders_18.vortex 100 vortex-file-compressed 180.45 MB 0 B 180.45 MB -100.0%
part_15.vortex 100 vortex-file-compressed 28.48 MB 0 B 28.48 MB -100.0%
lineitem_14.vortex 100 vortex-file-compressed 147.79 MB 0 B 147.79 MB -100.0%
lineitem_10.vortex 100 vortex-file-compressed 148.35 MB 0 B 148.35 MB -100.0%
orders_1.vortex 100 vortex-file-compressed 179.92 MB 0 B 179.92 MB -100.0%
orders_9.vortex 100 vortex-file-compressed 180.11 MB 0 B 180.11 MB -100.0%
region_0.vortex 100 vortex-file-compressed 6.13 KB 0 B 6.13 KB -100.0%
part_17.vortex 100 vortex-file-compressed 28.41 MB 0 B 28.41 MB -100.0%
lineitem_98.vortex 100 vortex-file-compressed 148.59 MB 0 B 148.59 MB -100.0%
partsupp_18.vortex 100 vortex-file-compressed 191.38 MB 0 B 191.38 MB -100.0%
partsupp_15.vortex 100 vortex-file-compressed 191.52 MB 0 B 191.52 MB -100.0%
lineitem_120.vortex 100 vortex-file-compressed 147.10 MB 0 B 147.10 MB -100.0%
lineitem_33.vortex 100 vortex-file-compressed 147.74 MB 0 B 147.74 MB -100.0%
supplier_0.vortex 100 vortex-file-compressed 66.71 MB 0 B 66.71 MB -100.0%
lineitem_113.vortex 100 vortex-file-compressed 147.56 MB 0 B 147.56 MB -100.0%
lineitem_50.vortex 100 vortex-file-compressed 148.88 MB 0 B 148.88 MB -100.0%
lineitem_56.vortex 100 vortex-file-compressed 147.73 MB 0 B 147.73 MB -100.0%
orders_17.vortex 100 vortex-file-compressed 180.01 MB 0 B 180.01 MB -100.0%
orders_8.vortex 100 vortex-file-compressed 180.21 MB 0 B 180.21 MB -100.0%
lineitem_1.vortex 100 vortex-file-compressed 148.56 MB 0 B 148.56 MB -100.0%
part_3.vortex 100 vortex-file-compressed 28.43 MB 0 B 28.43 MB -100.0%
lineitem_31.vortex 100 vortex-file-compressed 148.50 MB 0 B 148.50 MB -100.0%
orders_20.vortex 100 vortex-file-compressed 179.85 MB 0 B 179.85 MB -100.0%
lineitem_69.vortex 100 vortex-file-compressed 148.10 MB 0 B 148.10 MB -100.0%
lineitem_109.vortex 100 vortex-file-compressed 148.03 MB 0 B 148.03 MB -100.0%
lineitem_95.vortex 100 vortex-file-compressed 147.49 MB 0 B 147.49 MB -100.0%
lineitem_118.vortex 100 vortex-file-compressed 147.83 MB 0 B 147.83 MB -100.0%
lineitem_6.vortex 100 vortex-file-compressed 147.90 MB 0 B 147.90 MB -100.0%
partsupp_8.vortex 100 vortex-file-compressed 191.49 MB 0 B 191.49 MB -100.0%
lineitem_34.vortex 100 vortex-file-compressed 148.93 MB 0 B 148.93 MB -100.0%
lineitem_42.vortex 100 vortex-file-compressed 148.38 MB 0 B 148.38 MB -100.0%
lineitem_71.vortex 100 vortex-file-compressed 147.94 MB 0 B 147.94 MB -100.0%
partsupp_5.vortex 100 vortex-file-compressed 191.41 MB 0 B 191.41 MB -100.0%
orders_5.vortex 100 vortex-file-compressed 180.03 MB 0 B 180.03 MB -100.0%
lineitem_82.vortex 100 vortex-file-compressed 148.37 MB 0 B 148.37 MB -100.0%
nation_0.vortex 100 vortex-file-compressed 10.97 KB 0 B 10.97 KB -100.0%
customer_0.vortex 100 vortex-file-compressed 261.80 MB 0 B 261.80 MB -100.0%
lineitem_5.vortex 100 vortex-file-compressed 148.16 MB 0 B 148.16 MB -100.0%
lineitem_7.vortex 100 vortex-file-compressed 147.86 MB 0 B 147.86 MB -100.0%
lineitem_75.vortex 100 vortex-file-compressed 147.88 MB 0 B 147.88 MB -100.0%
lineitem_91.vortex 100 vortex-file-compressed 148.27 MB 0 B 148.27 MB -100.0%
lineitem_74.vortex 100 vortex-file-compressed 147.55 MB 0 B 147.55 MB -100.0%
lineitem_45.vortex 100 vortex-file-compressed 146.88 MB 0 B 146.88 MB -100.0%
lineitem_20.vortex 100 vortex-file-compressed 148.78 MB 0 B 148.78 MB -100.0%
lineitem_85.vortex 100 vortex-file-compressed 147.92 MB 0 B 147.92 MB -100.0%
lineitem_64.vortex 100 vortex-file-compressed 147.72 MB 0 B 147.72 MB -100.0%
partsupp_1.vortex 100 vortex-file-compressed 191.69 MB 0 B 191.69 MB -100.0%
lineitem_103.vortex 100 vortex-file-compressed 148.37 MB 0 B 148.37 MB -100.0%
part_7.vortex 100 vortex-file-compressed 28.41 MB 0 B 28.41 MB -100.0%
lineitem_27.vortex 100 vortex-file-compressed 148.45 MB 0 B 148.45 MB -100.0%
lineitem_57.vortex 100 vortex-file-compressed 148.37 MB 0 B 148.37 MB -100.0%
lineitem_62.vortex 100 vortex-file-compressed 146.94 MB 0 B 146.94 MB -100.0%

Totals:

  • vortex-compact: 194.82 MB → 194.82 MB (0.0%)
  • vortex-file-compressed: 27.85 GB → 266.60 MB (-99.1%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 25, 2026 •
edited
Loading

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.7%
Vortex (geomean): 1.065x ➖
Parquet (geomean): 1.036x ➖
Shifts: Parquet (control) +3.6% · Median polish +4.4%

datafusion / vortex-file-compressed (1.085x ➖, 0↑ 36↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 26148519 25139990 1.04
tpcds_q02/datafusion:vortex-file-compressed 49969971 48551260 1.03
tpcds_q03/datafusion:vortex-file-compressed 17086236 15777772 1.08
tpcds_q04/datafusion:vortex-file-compressed 271522922 252608069 1.07
tpcds_q05/datafusion:vortex-file-compressed 🚨 47659355 41597026 1.15
tpcds_q06/datafusion:vortex-file-compressed 59799483 59196857 1.01
tpcds_q07/datafusion:vortex-file-compressed 46448375 42483304 1.09
tpcds_q08/datafusion:vortex-file-compressed 30983584 29207432 1.06
tpcds_q09/datafusion:vortex-file-compressed 48430368 44965651 1.08
tpcds_q10/datafusion:vortex-file-compressed 🚨 41961221 37558623 1.12
tpcds_q11/datafusion:vortex-file-compressed 138481052 130155908 1.06
tpcds_q12/datafusion:vortex-file-compressed 20616490 18927911 1.09
tpcds_q13/datafusion:vortex-file-compressed 47094493 43084697 1.09
tpcds_q14/datafusion:vortex-file-compressed 185239053 170941331 1.08
tpcds_q15/datafusion:vortex-file-compressed 🚨 30430199 27093912 1.12
tpcds_q16/datafusion:vortex-file-compressed 29984671 28310775 1.06
tpcds_q17/datafusion:vortex-file-compressed 66683193 61953678 1.08
tpcds_q18/datafusion:vortex-file-compressed 72374797 66399434 1.09
tpcds_q19/datafusion:vortex-file-compressed 🚨 23744891 21154665 1.12
tpcds_q20/datafusion:vortex-file-compressed 22002443 21465695 1.03
tpcds_q21/datafusion:vortex-file-compressed 36207931 36248205 1.00
tpcds_q22/datafusion:vortex-file-compressed 🚨 156493792 112089178 1.40
tpcds_q23/datafusion:vortex-file-compressed 161944504 156037713 1.04
tpcds_q24/datafusion:vortex-file-compressed 87116623 81585796 1.07
tpcds_q25/datafusion:vortex-file-compressed 70737405 64747921 1.09
tpcds_q26/datafusion:vortex-file-compressed 🚨 36915782 33134628 1.11
tpcds_q27/datafusion:vortex-file-compressed 🚨 114127500 101162531 1.13
tpcds_q28/datafusion:vortex-file-compressed 41728743 40692329 1.03
tpcds_q29/datafusion:vortex-file-compressed 65886804 63153701 1.04
tpcds_q30/datafusion:vortex-file-compressed 🚨 24831754 22543741 1.10
tpcds_q31/datafusion:vortex-file-compressed 🚨 79636405 71927024 1.11
tpcds_q32/datafusion:vortex-file-compressed 22208388 20192764 1.10
tpcds_q33/datafusion:vortex-file-compressed 32084531 29359101 1.09
tpcds_q34/datafusion:vortex-file-compressed 26412793 24299220 1.09
tpcds_q35/datafusion:vortex-file-compressed 48068399 44868162 1.07
tpcds_q36/datafusion:vortex-file-compressed 57549102 56750720 1.01
tpcds_q37/datafusion:vortex-file-compressed 🚨 28565285 24779917 1.15
tpcds_q38/datafusion:vortex-file-compressed 🚨 48629579 43047165 1.13
tpcds_q39/datafusion:vortex-file-compressed 🚨 117919615 104358000 1.13
tpcds_q40/datafusion:vortex-file-compressed 35030845 32130668 1.09
tpcds_q41/datafusion:vortex-file-compressed 🚨 17673092 15337261 1.15
tpcds_q42/datafusion:vortex-file-compressed 🚨 15558451 13947049 1.12
tpcds_q43/datafusion:vortex-file-compressed 19225752 18505515 1.04
tpcds_q44/datafusion:vortex-file-compressed 32275592 32927578 0.98
tpcds_q45/datafusion:vortex-file-compressed 26473523 26433496 1.00
tpcds_q46/datafusion:vortex-file-compressed 35191300 34282586 1.03
tpcds_q47/datafusion:vortex-file-compressed 🚨 142674409 129037611 1.11
tpcds_q48/datafusion:vortex-file-compressed 40652441 37548962 1.08
tpcds_q49/datafusion:vortex-file-compressed 62340135 56885706 1.10
tpcds_q50/datafusion:vortex-file-compressed 42277973 38558496 1.10
tpcds_q51/datafusion:vortex-file-compressed 89665719 90609130 0.99
tpcds_q52/datafusion:vortex-file-compressed 15504105 14342554 1.08
tpcds_q53/datafusion:vortex-file-compressed 22538189 20708206 1.09
tpcds_q54/datafusion:vortex-file-compressed 🚨 37263539 33668565 1.11
tpcds_q55/datafusion:vortex-file-compressed 🚨 15726152 13516362 1.16
tpcds_q56/datafusion:vortex-file-compressed 🚨 32411989 28784598 1.13
tpcds_q57/datafusion:vortex-file-compressed 110554689 106860150 1.03
tpcds_q58/datafusion:vortex-file-compressed 53797654 51781194 1.04
tpcds_q59/datafusion:vortex-file-compressed 60734893 57112597 1.06
tpcds_q60/datafusion:vortex-file-compressed 32220922 29824892 1.08
tpcds_q61/datafusion:vortex-file-compressed 🚨 44997243 40248990 1.12
tpcds_q62/datafusion:vortex-file-compressed 🚨 28891133 21410536 1.35
tpcds_q63/datafusion:vortex-file-compressed 🚨 22742547 20612731 1.10
tpcds_q64/datafusion:vortex-file-compressed 437457088 404406092 1.08
tpcds_q65/datafusion:vortex-file-compressed 42308351 39175106 1.08
tpcds_q66/datafusion:vortex-file-compressed 🚨 77968300 70131548 1.11
tpcds_q67/datafusion:vortex-file-compressed 155545996 148245955 1.05
tpcds_q68/datafusion:vortex-file-compressed 34269792 36124486 0.95
tpcds_q69/datafusion:vortex-file-compressed 39027863 36076724 1.08
tpcds_q70/datafusion:vortex-file-compressed 🚨 91608411 81589901 1.12
tpcds_q71/datafusion:vortex-file-compressed 24923873 23144895 1.08
tpcds_q72/datafusion:vortex-file-compressed 🚨 2310901303 2083905349 1.11
tpcds_q73/datafusion:vortex-file-compressed 24934184 22792767 1.09
tpcds_q74/datafusion:vortex-file-compressed 84565769 79504363 1.06
tpcds_q75/datafusion:vortex-file-compressed 113759160 107413784 1.06
tpcds_q76/datafusion:vortex-file-compressed 26074209 23736456 1.10
tpcds_q77/datafusion:vortex-file-compressed 🚨 42472399 38610963 1.10
tpcds_q78/datafusion:vortex-file-compressed 🚨 133808920 120092675 1.11
tpcds_q79/datafusion:vortex-file-compressed 🚨 31332175 27525954 1.14
tpcds_q80/datafusion:vortex-file-compressed 🚨 103801996 92817020 1.12
tpcds_q81/datafusion:vortex-file-compressed 🚨 27118602 23729448 1.14
tpcds_q82/datafusion:vortex-file-compressed 🚨 29274282 26078427 1.12
tpcds_q83/datafusion:vortex-file-compressed 35926711 33872734 1.06
tpcds_q84/datafusion:vortex-file-compressed 🚨 14422957 12501835 1.15
tpcds_q85/datafusion:vortex-file-compressed 🚨 100500479 88699856 1.13
tpcds_q86/datafusion:vortex-file-compressed 🚨 18247471 15377967 1.19
tpcds_q87/datafusion:vortex-file-compressed 43983974 43730807 1.01
tpcds_q88/datafusion:vortex-file-compressed 60348906 55954036 1.08
tpcds_q89/datafusion:vortex-file-compressed 26562507 24245085 1.10
tpcds_q90/datafusion:vortex-file-compressed 15773105 14953116 1.05
tpcds_q91/datafusion:vortex-file-compressed 🚨 20923582 17840869 1.17
tpcds_q92/datafusion:vortex-file-compressed 🚨 21505319 18036963 1.19
tpcds_q93/datafusion:vortex-file-compressed 🚨 37426485 32240215 1.16
tpcds_q94/datafusion:vortex-file-compressed 25768873 26365124 0.98
tpcds_q95/datafusion:vortex-file-compressed 64671920 61376822 1.05
tpcds_q96/datafusion:vortex-file-compressed 14139736 13244245 1.07
tpcds_q97/datafusion:vortex-file-compressed 32536005 32055002 1.02
tpcds_q98/datafusion:vortex-file-compressed 23812763 23968403 0.99
tpcds_q99/datafusion:vortex-file-compressed 30008988 31895885 0.94
datafusion / vortex-compact (1.036x ➖, 0↑ 3↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 26710002 26257856 1.02
tpcds_q02/datafusion:vortex-compact 56778011 53793604 1.06
tpcds_q03/datafusion:vortex-compact 20555579 19236269 1.07
tpcds_q04/datafusion:vortex-compact 308386587 291387565 1.06
tpcds_q05/datafusion:vortex-compact 🚨 54253378 48155090 1.13
tpcds_q06/datafusion:vortex-compact 61259787 63298995 0.97
tpcds_q07/datafusion:vortex-compact 55780340 52109379 1.07
tpcds_q08/datafusion:vortex-compact 36689141 35106860 1.05
tpcds_q09/datafusion:vortex-compact 64444006 61698916 1.04
tpcds_q10/datafusion:vortex-compact 52449833 48790638 1.07
tpcds_q11/datafusion:vortex-compact 158657907 152053770 1.04
tpcds_q12/datafusion:vortex-compact 24329753 23930236 1.02
tpcds_q13/datafusion:vortex-compact 94033919 90760022 1.04
tpcds_q14/datafusion:vortex-compact 215921877 198241058 1.09
tpcds_q15/datafusion:vortex-compact 29732888 29590329 1.00
tpcds_q16/datafusion:vortex-compact 34927623 34341092 1.02
tpcds_q17/datafusion:vortex-compact 76299855 72649759 1.05
tpcds_q18/datafusion:vortex-compact 82066281 75669073 1.08
tpcds_q19/datafusion:vortex-compact 32531354 30038520 1.08
tpcds_q20/datafusion:vortex-compact 26962003 25087738 1.07
tpcds_q21/datafusion:vortex-compact 🚨 43830060 39093453 1.12
tpcds_q22/datafusion:vortex-compact 128877204 119032978 1.08
tpcds_q23/datafusion:vortex-compact 172884307 162537259 1.06
tpcds_q24/datafusion:vortex-compact 102272276 95715879 1.07
tpcds_q25/datafusion:vortex-compact 85234694 78554582 1.09
tpcds_q26/datafusion:vortex-compact 46850666 44052221 1.06
tpcds_q27/datafusion:vortex-compact 132389393 122905519 1.08
tpcds_q28/datafusion:vortex-compact 80865778 79141007 1.02
tpcds_q29/datafusion:vortex-compact 77237770 72112370 1.07
tpcds_q30/datafusion:vortex-compact 29784391 27098539 1.10
tpcds_q31/datafusion:vortex-compact 102599100 94473326 1.09
tpcds_q32/datafusion:vortex-compact 25620310 27143708 0.94
tpcds_q33/datafusion:vortex-compact 36405970 37548657 0.97
tpcds_q34/datafusion:vortex-compact 32212417 32129572 1.00
tpcds_q35/datafusion:vortex-compact 50786633 50411172 1.01
tpcds_q36/datafusion:vortex-compact 76648239 74815137 1.02
tpcds_q37/datafusion:vortex-compact 40676705 39042647 1.04
tpcds_q38/datafusion:vortex-compact 50957931 50204776 1.02
tpcds_q39/datafusion:vortex-compact 110073911 111589104 0.99
tpcds_q40/datafusion:vortex-compact 36200908 35836707 1.01
tpcds_q41/datafusion:vortex-compact 18307537 17289316 1.06
tpcds_q42/datafusion:vortex-compact 18430365 18732735 0.98
tpcds_q43/datafusion:vortex-compact 25583542 25137289 1.02
tpcds_q44/datafusion:vortex-compact 49324350 48502904 1.02
tpcds_q45/datafusion:vortex-compact 32899041 30965713 1.06
tpcds_q46/datafusion:vortex-compact 45128693 45009539 1.00
tpcds_q47/datafusion:vortex-compact 153148318 149299788 1.03
tpcds_q48/datafusion:vortex-compact 73819642 72908140 1.01
tpcds_q49/datafusion:vortex-compact 71404012 68207447 1.05
tpcds_q50/datafusion:vortex-compact 47594384 46375745 1.03
tpcds_q51/datafusion:vortex-compact 95970379 92932702 1.03
tpcds_q52/datafusion:vortex-compact 19526221 18468178 1.06
tpcds_q53/datafusion:vortex-compact 28443025 27384908 1.04
tpcds_q54/datafusion:vortex-compact 42511521 42135293 1.01
tpcds_q55/datafusion:vortex-compact 18945976 18981857 1.00
tpcds_q56/datafusion:vortex-compact 38456684 35935159 1.07
tpcds_q57/datafusion:vortex-compact 114143459 114951922 0.99
tpcds_q58/datafusion:vortex-compact 62939093 63525781 0.99
tpcds_q59/datafusion:vortex-compact 70060755 69808046 1.00
tpcds_q60/datafusion:vortex-compact 36373630 35810810 1.02
tpcds_q61/datafusion:vortex-compact 55278498 54713643 1.01
tpcds_q62/datafusion:vortex-compact 26632098 24856408 1.07
tpcds_q63/datafusion:vortex-compact 29424761 28409290 1.04
tpcds_q64/datafusion:vortex-compact 460579090 442545386 1.04
tpcds_q65/datafusion:vortex-compact 55985318 52910485 1.06
tpcds_q66/datafusion:vortex-compact 81480113 77659148 1.05
tpcds_q67/datafusion:vortex-compact 157817834 145196754 1.09
tpcds_q68/datafusion:vortex-compact 45625021 47632583 0.96
tpcds_q69/datafusion:vortex-compact 49595959 46560220 1.07
tpcds_q70/datafusion:vortex-compact 102492989 96444450 1.06
tpcds_q71/datafusion:vortex-compact 31277849 30761374 1.02
tpcds_q72/datafusion:vortex-compact 🚨 2287594818 2073335433 1.10
tpcds_q73/datafusion:vortex-compact 32145047 30757678 1.05
tpcds_q74/datafusion:vortex-compact 98212041 92276453 1.06
tpcds_q75/datafusion:vortex-compact 131100728 125994201 1.04
tpcds_q76/datafusion:vortex-compact 33257288 31837307 1.04
tpcds_q77/datafusion:vortex-compact 52765308 52239064 1.01
tpcds_q78/datafusion:vortex-compact 144241149 135334378 1.07
tpcds_q79/datafusion:vortex-compact 39122291 39713488 0.99
tpcds_q80/datafusion:vortex-compact 108623282 102013597 1.06
tpcds_q81/datafusion:vortex-compact 29006936 26888582 1.08
tpcds_q82/datafusion:vortex-compact 41376957 41890686 0.99
tpcds_q83/datafusion:vortex-compact 34296319 34305209 1.00
tpcds_q84/datafusion:vortex-compact 15501280 14463431 1.07
tpcds_q85/datafusion:vortex-compact 120376288 115850488 1.04
tpcds_q86/datafusion:vortex-compact 20298679 21959244 0.92
tpcds_q87/datafusion:vortex-compact 55385425 53270237 1.04
tpcds_q88/datafusion:vortex-compact 78859090 77957962 1.01
tpcds_q89/datafusion:vortex-compact 31534942 30722338 1.03
tpcds_q90/datafusion:vortex-compact 16138033 15250844 1.06
tpcds_q91/datafusion:vortex-compact 33677540 33870350 0.99
tpcds_q92/datafusion:vortex-compact 26000122 24425446 1.06
tpcds_q93/datafusion:vortex-compact 41058018 38163540 1.08
tpcds_q94/datafusion:vortex-compact 27744093 26380904 1.05
tpcds_q95/datafusion:vortex-compact 65038682 61442909 1.06
tpcds_q96/datafusion:vortex-compact 17650597 17143606 1.03
tpcds_q97/datafusion:vortex-compact 37078341 37012842 1.00
tpcds_q98/datafusion:vortex-compact 29803954 29538013 1.01
tpcds_q99/datafusion:vortex-compact 31744536 35106972 0.90
datafusion / parquet (1.030x ➖, 0↑ 7↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 29790202 29028851 1.03
tpcds_q02/datafusion:parquet 41875504 41775359 1.00
tpcds_q03/datafusion:parquet 14372305 14168435 1.01
tpcds_q04/datafusion:parquet 263841935 262013902 1.01
tpcds_q05/datafusion:parquet 42275109 41038177 1.03
tpcds_q06/datafusion:parquet 58997566 58299593 1.01
tpcds_q07/datafusion:parquet 78592368 76995458 1.02
tpcds_q08/datafusion:parquet 26986289 26076663 1.03
tpcds_q09/datafusion:parquet 44954687 43221232 1.04
tpcds_q10/datafusion:parquet 74091741 72438534 1.02
tpcds_q11/datafusion:parquet 🚨 163119463 146404326 1.11
tpcds_q12/datafusion:parquet 18091475 17449151 1.04
tpcds_q13/datafusion:parquet 76574589 74786200 1.02
tpcds_q14/datafusion:parquet 162779809 159403405 1.02
tpcds_q15/datafusion:parquet 21000821 21059431 1.00
tpcds_q16/datafusion:parquet 24427120 24702372 0.99
tpcds_q17/datafusion:parquet 61980960 64871936 0.96
tpcds_q18/datafusion:parquet 112233798 114801570 0.98
tpcds_q19/datafusion:parquet 🚨 24870059 22006362 1.13
tpcds_q20/datafusion:parquet 16606377 16285148 1.02
tpcds_q21/datafusion:parquet 18238898 18348312 0.99
tpcds_q22/datafusion:parquet 136820349 151921070 0.90
tpcds_q23/datafusion:parquet 143491144 142078466 1.01
tpcds_q24/datafusion:parquet 90151852 91670260 0.98
tpcds_q25/datafusion:parquet 62962950 63009586 1.00
tpcds_q26/datafusion:parquet 65601201 67862561 0.97
tpcds_q27/datafusion:parquet 144885481 144051604 1.01
tpcds_q28/datafusion:parquet 44533925 45345099 0.98
tpcds_q29/datafusion:parquet 65895275 64791740 1.02
tpcds_q30/datafusion:parquet 34937969 34714618 1.01
tpcds_q31/datafusion:parquet 64264001 64859275 0.99
tpcds_q32/datafusion:parquet 18627197 18884095 0.99
tpcds_q33/datafusion:parquet 27166033 27268035 1.00
tpcds_q34/datafusion:parquet 21146990 23022000 0.92
tpcds_q35/datafusion:parquet 73594005 68813419 1.07
tpcds_q36/datafusion:parquet 55796638 55184996 1.01
tpcds_q37/datafusion:parquet 18481751 19013992 0.97
tpcds_q38/datafusion:parquet 40437925 41457391 0.98
tpcds_q39/datafusion:parquet 70534011 69587105 1.01
tpcds_q40/datafusion:parquet 23665203 23109878 1.02
tpcds_q41/datafusion:parquet 13043645 12710180 1.03
tpcds_q42/datafusion:parquet 12146154 11408707 1.06
tpcds_q43/datafusion:parquet 16382778 16219710 1.01
tpcds_q44/datafusion:parquet 33161351 33658993 0.99
tpcds_q45/datafusion:parquet 27523448 27494007 1.00
tpcds_q46/datafusion:parquet 32565603 31134452 1.05
tpcds_q47/datafusion:parquet 123730278 123900434 1.00
tpcds_q48/datafusion:parquet 68569348 68732100 1.00
tpcds_q49/datafusion:parquet 56444603 53602101 1.05
tpcds_q50/datafusion:parquet 43868999 44025941 1.00
tpcds_q51/datafusion:parquet 82190307 84915673 0.97
tpcds_q52/datafusion:parquet 11834349 11737438 1.01
tpcds_q53/datafusion:parquet 18243004 17217066 1.06
tpcds_q54/datafusion:parquet 32893761 33551801 0.98
tpcds_q55/datafusion:parquet 11595925 11170722 1.04
tpcds_q56/datafusion:parquet 28076733 26805111 1.05
tpcds_q57/datafusion:parquet 91447151 90373517 1.01
tpcds_q58/datafusion:parquet 51323660 48716551 1.05
tpcds_q59/datafusion:parquet 51878455 52534105 0.99
tpcds_q60/datafusion:parquet 27098678 27631931 0.98
tpcds_q61/datafusion:parquet 43156243 41861818 1.03
tpcds_q62/datafusion:parquet 19440966 20807832 0.93
tpcds_q63/datafusion:parquet 17962935 17177682 1.05
tpcds_q64/datafusion:parquet 515474201 506207859 1.02
tpcds_q65/datafusion:parquet 39131397 36569260 1.07
tpcds_q66/datafusion:parquet 73884896 68840004 1.07
tpcds_q67/datafusion:parquet 153081201 143235168 1.07
tpcds_q68/datafusion:parquet 33809222 31740192 1.07
tpcds_q69/datafusion:parquet 73469693 67972524 1.08
tpcds_q70/datafusion:parquet 87762639 87906975 1.00
tpcds_q71/datafusion:parquet 23897109 22269376 1.07
tpcds_q72/datafusion:parquet 635520333 584048771 1.09
tpcds_q73/datafusion:parquet 21964667 21114309 1.04
tpcds_q74/datafusion:parquet 88051813 82095013 1.07
tpcds_q75/datafusion:parquet 103653310 98147109 1.06
tpcds_q76/datafusion:parquet 30889642 28924965 1.07
tpcds_q77/datafusion:parquet 41014419 39289171 1.04
tpcds_q78/datafusion:parquet 117837002 107430749 1.10
tpcds_q79/datafusion:parquet 27331046 25826777 1.06
tpcds_q80/datafusion:parquet 83478232 77069399 1.08
tpcds_q81/datafusion:parquet 34187013 32443771 1.05
tpcds_q82/datafusion:parquet 20921248 19278678 1.09
tpcds_q83/datafusion:parquet 39136625 35866552 1.09
tpcds_q84/datafusion:parquet 41023101 38721511 1.06
tpcds_q85/datafusion:parquet 158809435 149393834 1.06
tpcds_q86/datafusion:parquet 16861775 15669038 1.08
tpcds_q87/datafusion:parquet 🚨 44914932 39733444 1.13
tpcds_q88/datafusion:parquet 60411937 58142323 1.04
tpcds_q89/datafusion:parquet 22191496 21743332 1.02
tpcds_q90/datafusion:parquet 14015289 14224836 0.99
tpcds_q91/datafusion:parquet 63450477 60060166 1.06
tpcds_q92/datafusion:parquet 🚨 19590488 17606948 1.11
tpcds_q93/datafusion:parquet 🚨 33487768 30036887 1.11
tpcds_q94/datafusion:parquet 21679248 20844373 1.04
tpcds_q95/datafusion:parquet 61823078 56600323 1.09
tpcds_q96/datafusion:parquet 13118996 12206409 1.07
tpcds_q97/datafusion:parquet 🚨 32379661 29364797 1.10
tpcds_q98/datafusion:parquet 23036607 21295757 1.08
tpcds_q99/datafusion:parquet 🚨 27463394 24488392 1.12
duckdb / vortex-file-compressed (1.098x ➖, 0↑ 45↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 🚨 25348734 21194750 1.20
tpcds_q02/duckdb:vortex-file-compressed 🚨 35179590 30171540 1.17
tpcds_q03/duckdb:vortex-file-compressed 32913054 30393778 1.08
tpcds_q04/duckdb:vortex-file-compressed 109120003 100807631 1.08
tpcds_q05/duckdb:vortex-file-compressed 39840979 37565554 1.06
tpcds_q06/duckdb:vortex-file-compressed 🚨 36986946 30792922 1.20
tpcds_q07/duckdb:vortex-file-compressed 🚨 24996867 19056015 1.31
tpcds_q08/duckdb:vortex-file-compressed 28797945 28874573 1.00
tpcds_q09/duckdb:vortex-file-compressed 38670669 38885469 0.99
tpcds_q10/duckdb:vortex-file-compressed 42524520 39140790 1.09
tpcds_q11/duckdb:vortex-file-compressed 🚨 71489940 60904837 1.17
tpcds_q12/duckdb:vortex-file-compressed 🚨 17210548 13842980 1.24
tpcds_q13/duckdb:vortex-file-compressed 🚨 37659422 31482763 1.20
tpcds_q14/duckdb:vortex-file-compressed 105389640 100549834 1.05
tpcds_q15/duckdb:vortex-file-compressed 27182057 25972801 1.05
tpcds_q16/duckdb:vortex-file-compressed 🚨 33625199 26895287 1.25
tpcds_q17/duckdb:vortex-file-compressed 🚨 50060489 42267915 1.18
tpcds_q18/duckdb:vortex-file-compressed 🚨 52370839 46043378 1.14
tpcds_q19/duckdb:vortex-file-compressed 34029144 31999048 1.06
tpcds_q20/duckdb:vortex-file-compressed 16126259 15331498 1.05
tpcds_q21/duckdb:vortex-file-compressed 🚨 17940124 16021255 1.12
tpcds_q22/duckdb:vortex-file-compressed 🚨 83632678 71250031 1.17
tpcds_q23/duckdb:vortex-file-compressed 115752704 108715998 1.06
tpcds_q24/duckdb:vortex-file-compressed 50211517 49247171 1.02
tpcds_q25/duckdb:vortex-file-compressed 52527476 50118192 1.05
tpcds_q26/duckdb:vortex-file-compressed 🚨 45253897 40252993 1.12
tpcds_q27/duckdb:vortex-file-compressed 🚨 52726714 44138092 1.19
tpcds_q28/duckdb:vortex-file-compressed 36924718 35515399 1.04
tpcds_q29/duckdb:vortex-file-compressed 43611585 41269084 1.06
tpcds_q30/duckdb:vortex-file-compressed 🚨 28704164 23972274 1.20
tpcds_q31/duckdb:vortex-file-compressed 🚨 40103414 33955385 1.18
tpcds_q32/duckdb:vortex-file-compressed 🚨 16793850 13583741 1.24
tpcds_q33/duckdb:vortex-file-compressed 25941133 24200152 1.07
tpcds_q34/duckdb:vortex-file-compressed 23749265 23285623 1.02
tpcds_q35/duckdb:vortex-file-compressed 🚨 71170981 63809556 1.12
tpcds_q36/duckdb:vortex-file-compressed 27280927 24974153 1.09
tpcds_q37/duckdb:vortex-file-compressed 🚨 18799377 14861579 1.26
tpcds_q38/duckdb:vortex-file-compressed 40566591 37483358 1.08
tpcds_q39/duckdb:vortex-file-compressed 34582467 33378825 1.04
tpcds_q40/duckdb:vortex-file-compressed 🚨 22698848 19299185 1.18
tpcds_q41/duckdb:vortex-file-compressed 🚨 15308665 12775763 1.20
tpcds_q42/duckdb:vortex-file-compressed 13770069 13387770 1.03
tpcds_q43/duckdb:vortex-file-compressed 🚨 25930909 22945589 1.13
tpcds_q44/duckdb:vortex-file-compressed 🚨 23108726 20768132 1.11
tpcds_q45/duckdb:vortex-file-compressed 29540663 28072887 1.05
tpcds_q46/duckdb:vortex-file-compressed 55094574 51245083 1.08
tpcds_q47/duckdb:vortex-file-compressed 🚨 52007255 46644666 1.11
tpcds_q48/duckdb:vortex-file-compressed 🚨 34036500 29706257 1.15
tpcds_q49/duckdb:vortex-file-compressed 36833018 35632215 1.03
tpcds_q50/duckdb:vortex-file-compressed 33791079 34851264 0.97
tpcds_q51/duckdb:vortex-file-compressed 101856455 95784362 1.06
tpcds_q52/duckdb:vortex-file-compressed 🚨 15690419 13366565 1.17
tpcds_q53/duckdb:vortex-file-compressed 🚨 25356672 22857333 1.11
tpcds_q54/duckdb:vortex-file-compressed 28753336 28821885 1.00
tpcds_q55/duckdb:vortex-file-compressed 14015323 12793653 1.10
tpcds_q56/duckdb:vortex-file-compressed 25358391 23530207 1.08
tpcds_q57/duckdb:vortex-file-compressed 🚨 44098777 40014781 1.10
tpcds_q58/duckdb:vortex-file-compressed 🚨 33766005 30583430 1.10
tpcds_q59/duckdb:vortex-file-compressed 66501067 67119799 0.99
tpcds_q60/duckdb:vortex-file-compressed 27116301 25361891 1.07
tpcds_q61/duckdb:vortex-file-compressed 35887094 34529098 1.04
tpcds_q62/duckdb:vortex-file-compressed 🚨 20516451 18191318 1.13
tpcds_q63/duckdb:vortex-file-compressed 🚨 24118647 20923384 1.15
tpcds_q64/duckdb:vortex-file-compressed 87525418 81668271 1.07
tpcds_q65/duckdb:vortex-file-compressed 22760579 22847810 1.00
tpcds_q66/duckdb:vortex-file-compressed 🚨 33638617 29057100 1.16
tpcds_q67/duckdb:vortex-file-compressed 146726693 137910939 1.06
tpcds_q68/duckdb:vortex-file-compressed 🚨 46291974 40433576 1.14
tpcds_q69/duckdb:vortex-file-compressed 43201369 42249923 1.02
tpcds_q70/duckdb:vortex-file-compressed 🚨 28865252 25368861 1.14
tpcds_q71/duckdb:vortex-file-compressed 🚨 24791805 20422975 1.21
tpcds_q72/duckdb:vortex-file-compressed 181109418 170086681 1.06
tpcds_q73/duckdb:vortex-file-compressed 🚨 26356226 22313500 1.18
tpcds_q74/duckdb:vortex-file-compressed 75540490 71951658 1.05
tpcds_q75/duckdb:vortex-file-compressed 59410920 58091376 1.02
tpcds_q76/duckdb:vortex-file-compressed 🚨 21125137 18130396 1.17
tpcds_q77/duckdb:vortex-file-compressed 🚨 29630406 25066195 1.18
tpcds_q78/duckdb:vortex-file-compressed 77406478 76085468 1.02
tpcds_q79/duckdb:vortex-file-compressed 33030506 31664470 1.04
tpcds_q80/duckdb:vortex-file-compressed 🚨 57164967 46644510 1.23
tpcds_q81/duckdb:vortex-file-compressed 🚨 30100502 27165676 1.11
tpcds_q82/duckdb:vortex-file-compressed 17721772 16277268 1.09
tpcds_q83/duckdb:vortex-file-compressed 🚨 24799840 22229748 1.12
tpcds_q84/duckdb:vortex-file-compressed 🚨 21614740 18478626 1.17
tpcds_q85/duckdb:vortex-file-compressed 🚨 53272790 44425813 1.20
tpcds_q86/duckdb:vortex-file-compressed 17704559 16681105 1.06
tpcds_q87/duckdb:vortex-file-compressed 40838636 40784815 1.00
tpcds_q88/duckdb:vortex-file-compressed 34531146 32279739 1.07
tpcds_q89/duckdb:vortex-file-compressed 22514036 23330488 0.97
tpcds_q90/duckdb:vortex-file-compressed 🚨 12894770 11721679 1.10
tpcds_q91/duckdb:vortex-file-compressed 31819562 30695466 1.04
tpcds_q92/duckdb:vortex-file-compressed 🚨 26064466 20951975 1.24
tpcds_q93/duckdb:vortex-file-compressed 29420741 27313491 1.08
tpcds_q94/duckdb:vortex-file-compressed 25211505 24251652 1.04
tpcds_q95/duckdb:vortex-file-compressed 151344022 150734253 1.00
tpcds_q96/duckdb:vortex-file-compressed 12070605 13243719 0.91
tpcds_q97/duckdb:vortex-file-compressed 37559539 37189264 1.01
tpcds_q98/duckdb:vortex-file-compressed 18724790 17591346 1.06
tpcds_q99/duckdb:vortex-file-compressed 27766012 26250933 1.06
duckdb / vortex-compact (1.043x ➖, 0↑ 13↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 23595102 22518197 1.05
tpcds_q02/duckdb:vortex-compact 38927940 39223749 0.99
tpcds_q03/duckdb:vortex-compact 56862671 56713405 1.00
tpcds_q04/duckdb:vortex-compact 115268543 118323027 0.97
tpcds_q05/duckdb:vortex-compact 52491968 50125887 1.05
tpcds_q06/duckdb:vortex-compact 41420545 39812765 1.04
tpcds_q07/duckdb:vortex-compact 35463946 36670874 0.97
tpcds_q08/duckdb:vortex-compact 44858174 45478812 0.99
tpcds_q09/duckdb:vortex-compact 57602665 56501457 1.02
tpcds_q10/duckdb:vortex-compact 60773479 62672473 0.97
tpcds_q11/duckdb:vortex-compact 75089485 72129228 1.04
tpcds_q12/duckdb:vortex-compact 22929665 22476110 1.02
tpcds_q13/duckdb:vortex-compact 61149045 57163225 1.07
tpcds_q14/duckdb:vortex-compact 137171344 129267362 1.06
tpcds_q15/duckdb:vortex-compact 🚨 34135367 29857637 1.14
tpcds_q16/duckdb:vortex-compact 🚨 35537277 29794514 1.19
tpcds_q17/duckdb:vortex-compact 53988799 53757143 1.00
tpcds_q18/duckdb:vortex-compact 57461521 57762284 0.99
tpcds_q19/duckdb:vortex-compact 53629712 51232745 1.05
tpcds_q20/duckdb:vortex-compact 21069075 20323302 1.04
tpcds_q21/duckdb:vortex-compact 19818413 20464175 0.97
tpcds_q22/duckdb:vortex-compact 74124651 74420148 1.00
tpcds_q23/duckdb:vortex-compact 121753396 120232110 1.01
tpcds_q24/duckdb:vortex-compact 61804690 61707249 1.00
tpcds_q25/duckdb:vortex-compact 83746456 82856607 1.01
tpcds_q26/duckdb:vortex-compact 51379183 49643599 1.03
tpcds_q27/duckdb:vortex-compact 70774467 71036965 1.00
tpcds_q28/duckdb:vortex-compact 85683215 85372069 1.00
tpcds_q29/duckdb:vortex-compact 54797353 53196464 1.03
tpcds_q30/duckdb:vortex-compact 28261198 28587840 0.99
tpcds_q31/duckdb:vortex-compact 47253600 47131613 1.00
tpcds_q32/duckdb:vortex-compact 23632476 21717165 1.09
tpcds_q33/duckdb:vortex-compact 37513213 35218026 1.07
tpcds_q34/duckdb:vortex-compact 39845902 39843673 1.00
tpcds_q35/duckdb:vortex-compact 81775898 80228006 1.02
tpcds_q36/duckdb:vortex-compact 42798093 41138237 1.04
tpcds_q37/duckdb:vortex-compact 25800345 23699146 1.09
tpcds_q38/duckdb:vortex-compact 48433227 49460587 0.98
tpcds_q39/duckdb:vortex-compact 36366205 37162726 0.98
tpcds_q40/duckdb:vortex-compact 25555327 24480462 1.04
tpcds_q41/duckdb:vortex-compact 🚨 17894238 15886021 1.13
tpcds_q42/duckdb:vortex-compact 23770081 22245491 1.07
tpcds_q43/duckdb:vortex-compact 34967120 35187077 0.99
tpcds_q44/duckdb:vortex-compact 28483246 29980947 0.95
tpcds_q45/duckdb:vortex-compact 38625315 39017178 0.99
tpcds_q46/duckdb:vortex-compact 75976760 72755258 1.04
tpcds_q47/duckdb:vortex-compact 62971285 61846421 1.02
tpcds_q48/duckdb:vortex-compact 52858158 52725600 1.00
tpcds_q49/duckdb:vortex-compact 58287437 54892996 1.06
tpcds_q50/duckdb:vortex-compact 49056563 47198972 1.04
tpcds_q51/duckdb:vortex-compact 112009425 106628528 1.05
tpcds_q52/duckdb:vortex-compact 23685732 21902830 1.08
tpcds_q53/duckdb:vortex-compact 40592868 39394006 1.03
tpcds_q54/duckdb:vortex-compact 41019614 40500298 1.01
tpcds_q55/duckdb:vortex-compact 23629827 22034925 1.07
tpcds_q56/duckdb:vortex-compact 38911053 35500160 1.10
tpcds_q57/duckdb:vortex-compact 44548739 43474162 1.02
tpcds_q58/duckdb:vortex-compact 41697803 44788002 0.93
tpcds_q59/duckdb:vortex-compact 90055689 85198448 1.06
tpcds_q60/duckdb:vortex-compact 🚨 41491021 37712835 1.10
tpcds_q61/duckdb:vortex-compact 70689744 65025204 1.09
tpcds_q62/duckdb:vortex-compact 25659062 26131931 0.98
tpcds_q63/duckdb:vortex-compact 38534730 37006564 1.04
tpcds_q64/duckdb:vortex-compact 122529056 115132722 1.06
tpcds_q65/duckdb:vortex-compact 34240840 33390066 1.03
tpcds_q66/duckdb:vortex-compact 🚨 43673419 39388853 1.11
tpcds_q67/duckdb:vortex-compact 158615246 148016713 1.07
tpcds_q68/duckdb:vortex-compact 66025449 64296020 1.03
tpcds_q69/duckdb:vortex-compact 66396605 61426488 1.08
tpcds_q70/duckdb:vortex-compact 38143205 36956273 1.03
tpcds_q71/duckdb:vortex-compact 35561388 34976710 1.02
tpcds_q72/duckdb:vortex-compact 192666859 190535868 1.01
tpcds_q73/duckdb:vortex-compact 39119014 38603063 1.01
tpcds_q74/duckdb:vortex-compact 85052116 82673216 1.03
tpcds_q75/duckdb:vortex-compact 77669513 73614531 1.06
tpcds_q76/duckdb:vortex-compact 36869315 34625894 1.06
tpcds_q77/duckdb:vortex-compact 44093978 41510353 1.06
tpcds_q78/duckdb:vortex-compact 95975438 89647117 1.07
tpcds_q79/duckdb:vortex-compact 55710105 52012287 1.07
tpcds_q80/duckdb:vortex-compact 🚨 92891994 78003602 1.19
tpcds_q81/duckdb:vortex-compact 33681399 32241156 1.04
tpcds_q82/duckdb:vortex-compact 🚨 27529277 24624623 1.12
tpcds_q83/duckdb:vortex-compact 🚨 37900131 31919394 1.19
tpcds_q84/duckdb:vortex-compact 28568532 26275160 1.09
tpcds_q85/duckdb:vortex-compact 🚨 64218915 55855650 1.15
tpcds_q86/duckdb:vortex-compact 25120040 24132042 1.04
tpcds_q87/duckdb:vortex-compact 53836544 51246050 1.05
tpcds_q88/duckdb:vortex-compact 41355058 39024506 1.06
tpcds_q89/duckdb:vortex-compact 40510132 38076731 1.06
tpcds_q90/duckdb:vortex-compact 16412553 15222497 1.08
tpcds_q91/duckdb:vortex-compact 52372647 51247544 1.02
tpcds_q92/duckdb:vortex-compact 45688515 49164728 0.93
tpcds_q93/duckdb:vortex-compact 🚨 35117667 31805785 1.10
tpcds_q94/duckdb:vortex-compact 🚨 36561975 28508334 1.28
tpcds_q95/duckdb:vortex-compact 161565843 162821666 0.99
tpcds_q96/duckdb:vortex-compact 17722206 18451359 0.96
tpcds_q97/duckdb:vortex-compact 45766573 42964992 1.07
tpcds_q98/duckdb:vortex-compact 🚨 32996939 28271262 1.17
tpcds_q99/duckdb:vortex-compact 🚨 34968095 31694589 1.10
duckdb / parquet (1.041x ➖, 1↑ 13↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 28934784 27479060 1.05
tpcds_q02/duckdb:parquet 23967585 23503373 1.02
tpcds_q03/duckdb:parquet 11789652 11214899 1.05
tpcds_q04/duckdb:parquet 161725737 164213485 0.98
tpcds_q05/duckdb:parquet 29869186 29703980 1.01
tpcds_q06/duckdb:parquet 27852742 27384517 1.02
tpcds_q07/duckdb:parquet 20405842 20862204 0.98
tpcds_q08/duckdb:parquet 26947985 26461617 1.02
tpcds_q09/duckdb:parquet 39336821 38904173 1.01
tpcds_q10/duckdb:parquet 33129675 31879976 1.04
tpcds_q11/duckdb:parquet 91168746 88905836 1.03
tpcds_q12/duckdb:parquet 15283582 13962936 1.09
tpcds_q13/duckdb:parquet 32664622 32166652 1.02
tpcds_q14/duckdb:parquet 99215560 97184013 1.02
tpcds_q15/duckdb:parquet 30735697 29893445 1.03
tpcds_q16/duckdb:parquet 21723750 20348847 1.07
tpcds_q17/duckdb:parquet 37775077 34692694 1.09
tpcds_q18/duckdb:parquet 45922174 44048228 1.04
tpcds_q19/duckdb:parquet 29079515 28399235 1.02
tpcds_q20/duckdb:parquet 15793168 14918564 1.06
tpcds_q21/duckdb:parquet 10349765 10577787 0.98
tpcds_q22/duckdb:parquet 71738434 67102586 1.07
tpcds_q23/duckdb:parquet 82371814 79391733 1.04
tpcds_q24/duckdb:parquet 44500453 43883486 1.01
tpcds_q25/duckdb:parquet 32924389 32497409 1.01
tpcds_q26/duckdb:parquet 35181858 34884517 1.01
tpcds_q27/duckdb:parquet 48441765 48646142 1.00
tpcds_q28/duckdb:parquet 38386104 37805391 1.02
tpcds_q29/duckdb:parquet 35372708 36358858 0.97
tpcds_q30/duckdb:parquet 37054896 34213848 1.08
tpcds_q31/duckdb:parquet 23400671 23898456 0.98
tpcds_q32/duckdb:parquet 🚨 12017603 10322314 1.16
tpcds_q33/duckdb:parquet 20288772 20955970 0.97
tpcds_q34/duckdb:parquet 21269663 19942935 1.07
tpcds_q35/duckdb:parquet 57022114 55752842 1.02
tpcds_q36/duckdb:parquet 19897709 19608828 1.01
tpcds_q37/duckdb:parquet 12612393 12419826 1.02
tpcds_q38/duckdb:parquet 33207173 33776705 0.98
tpcds_q39/duckdb:parquet 30392469 29212203 1.04
tpcds_q40/duckdb:parquet 17436657 17158101 1.02
tpcds_q41/duckdb:parquet 7833824 7461901 1.05
tpcds_q42/duckdb:parquet 🚨 10694321 9224083 1.16
tpcds_q43/duckdb:parquet 15287817 14689475 1.04
tpcds_q44/duckdb:parquet 22768988 21888440 1.04
tpcds_q45/duckdb:parquet 27198244 26360433 1.03
tpcds_q46/duckdb:parquet 45980137 45158129 1.02
tpcds_q47/duckdb:parquet 44417637 44561472 1.00
tpcds_q48/duckdb:parquet 29743954 29763636 1.00
tpcds_q49/duckdb:parquet 23584087 24087506 0.98
tpcds_q50/duckdb:parquet 24270205 23741562 1.02
tpcds_q51/duckdb:parquet 94908758 94399224 1.01
tpcds_q52/duckdb:parquet 10587669 10936525 0.97
tpcds_q53/duckdb:parquet 14983783 14676074 1.02
tpcds_q54/duckdb:parquet 25379098 25028681 1.01
tpcds_q55/duckdb:parquet 9674773 9586584 1.01
tpcds_q56/duckdb:parquet 19805106 20363980 0.97
tpcds_q57/duckdb:parquet 33745269 33779632 1.00
tpcds_q58/duckdb:parquet 22698174 22334310 1.02
tpcds_q59/duckdb:parquet 35646649 35029107 1.02
tpcds_q60/duckdb:parquet 21000402 21625383 0.97
tpcds_q61/duckdb:parquet 31768802 29979834 1.06
tpcds_q62/duckdb:parquet 11597890 12156486 0.95
tpcds_q63/duckdb:parquet 13630848 13767727 0.99
tpcds_q64/duckdb:parquet 73033152 74762005 0.98
tpcds_q65/duckdb:parquet 20806034 19083460 1.09
tpcds_q66/duckdb:parquet 🚀 28915020 32330393 0.89
tpcds_q67/duckdb:parquet 136076008 134348362 1.01
tpcds_q68/duckdb:parquet 36453398 36269620 1.01
tpcds_q69/duckdb:parquet 37108625 35676490 1.04
tpcds_q70/duckdb:parquet 20253344 20750789 0.98
tpcds_q71/duckdb:parquet 🚨 20525128 17881122 1.15
tpcds_q72/duckdb:parquet 173871875 163275555 1.06
tpcds_q73/duckdb:parquet 17888991 17119882 1.04
tpcds_q74/duckdb:parquet 134218812 131359939 1.02
tpcds_q75/duckdb:parquet 🚨 57519321 51008566 1.13
tpcds_q76/duckdb:parquet 20621696 19634846 1.05
tpcds_q77/duckdb:parquet 22459013 21007875 1.07
tpcds_q78/duckdb:parquet 80491485 73980728 1.09
tpcds_q79/duckdb:parquet 🚨 30064813 26980665 1.11
tpcds_q80/duckdb:parquet 42961009 40708132 1.06
tpcds_q81/duckdb:parquet 🚨 34877058 30649047 1.14
tpcds_q82/duckdb:parquet 🚨 14510852 13150122 1.10
tpcds_q83/duckdb:parquet 16773063 15315252 1.10
tpcds_q84/duckdb:parquet 19905230 19015274 1.05
tpcds_q85/duckdb:parquet 42909923 39281913 1.09
tpcds_q86/duckdb:parquet 🚨 13879667 12605628 1.10
tpcds_q87/duckdb:parquet 40648254 37523340 1.08
tpcds_q88/duckdb:parquet 49458554 47973938 1.03
tpcds_q89/duckdb:parquet 17299254 15907686 1.09
tpcds_q90/duckdb:parquet 7806172 7274280 1.07
tpcds_q91/duckdb:parquet 23636163 22142935 1.07
tpcds_q92/duckdb:parquet 🚨 12219259 11088947 1.10
tpcds_q93/duckdb:parquet 🚨 32408084 27883611 1.16
tpcds_q94/duckdb:parquet 🚨 18791471 15233063 1.23
tpcds_q95/duckdb:parquet 🚨 150138204 124942801 1.20
tpcds_q96/duckdb:parquet 8915761 8126900 1.10
tpcds_q97/duckdb:parquet 🚨 38347589 33891607 1.13
tpcds_q98/duckdb:parquet 18565567 17053374 1.09
tpcds_q99/duckdb:parquet 20355005 19189247 1.06
duckdb / duckdb (1.058x ➖, 0↑ 24↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 🚨 23036497 19826107 1.16
tpcds_q02/duckdb:duckdb 18604551 18630075 1.00
tpcds_q03/duckdb:duckdb 8585848 8847976 0.97
tpcds_q04/duckdb:duckdb 184921269 168545372 1.10
tpcds_q05/duckdb:duckdb 20943966 19369530 1.08
tpcds_q06/duckdb:duckdb 24558540 22370888 1.10
tpcds_q07/duckdb:duckdb 38807834 37151277 1.04
tpcds_q08/duckdb:duckdb 123253494 120300518 1.02
tpcds_q09/duckdb:duckdb 21197230 19667294 1.08
tpcds_q10/duckdb:duckdb 🚨 26431622 23569216 1.12
tpcds_q11/duckdb:duckdb 87243874 90867655 0.96
tpcds_q12/duckdb:duckdb 12234863 11500702 1.06
tpcds_q13/duckdb:duckdb 🚨 26379354 23715167 1.11
tpcds_q14/duckdb:duckdb 96293305 90336717 1.07
tpcds_q15/duckdb:duckdb 🚨 26909233 24252570 1.11
tpcds_q16/duckdb:duckdb 17359394 16826866 1.03
tpcds_q17/duckdb:duckdb 21096022 20698952 1.02
tpcds_q18/duckdb:duckdb 🚨 47700666 43021844 1.11
tpcds_q19/duckdb:duckdb 17888093 16655553 1.07
tpcds_q20/duckdb:duckdb 🚨 13603551 11970220 1.14
tpcds_q21/duckdb:duckdb 🚨 7521118 6612924 1.14
tpcds_q22/duckdb:duckdb 🚨 69063672 59743296 1.16
tpcds_q23/duckdb:duckdb 79083378 79307872 1.00
tpcds_q24/duckdb:duckdb 25887707 24478614 1.06
tpcds_q25/duckdb:duckdb 🚨 18696260 16645913 1.12
tpcds_q26/duckdb:duckdb 28241928 26385053 1.07
tpcds_q27/duckdb:duckdb 🚨 42479733 38595711 1.10
tpcds_q28/duckdb:duckdb 22910047 21286922 1.08
tpcds_q29/duckdb:duckdb 21865362 20131938 1.09
tpcds_q30/duckdb:duckdb 29523857 28515825 1.04
tpcds_q31/duckdb:duckdb 51363986 46868250 1.10
tpcds_q32/duckdb:duckdb 🚨 8784769 6983700 1.26
tpcds_q33/duckdb:duckdb 🚨 13776060 12511294 1.10
tpcds_q34/duckdb:duckdb 15910378 14867436 1.07
tpcds_q35/duckdb:duckdb 🚨 34208491 30675458 1.12
tpcds_q36/duckdb:duckdb 74876752 68949319 1.09
tpcds_q37/duckdb:duckdb 7454275 7535443 0.99
tpcds_q38/duckdb:duckdb 29362153 29533487 0.99
tpcds_q39/duckdb:duckdb 🚨 26606218 23898715 1.11
tpcds_q40/duckdb:duckdb 13773531 13389789 1.03
tpcds_q41/duckdb:duckdb 🚨 9104680 8244820 1.10
tpcds_q42/duckdb:duckdb 7183493 6682037 1.08
tpcds_q43/duckdb:duckdb 🚨 12410516 11054980 1.12
tpcds_q44/duckdb:duckdb 14005843 14556864 0.96
tpcds_q45/duckdb:duckdb 🚨 18509678 16595521 1.12
tpcds_q46/duckdb:duckdb 36732956 35348093 1.04
tpcds_q47/duckdb:duckdb 41289114 40555181 1.02
tpcds_q48/duckdb:duckdb 23673148 23132233 1.02
tpcds_q49/duckdb:duckdb 17720375 17029330 1.04
tpcds_q50/duckdb:duckdb 14505478 14381078 1.01
tpcds_q51/duckdb:duckdb 91939358 90324019 1.02
tpcds_q52/duckdb:duckdb 7703205 7174589 1.07
tpcds_q53/duckdb:duckdb 13976250 13164613 1.06
tpcds_q54/duckdb:duckdb 🚨 17716092 15765338 1.12
tpcds_q55/duckdb:duckdb 7221839 6803183 1.06
tpcds_q56/duckdb:duckdb 14166542 13007541 1.09
tpcds_q57/duckdb:duckdb 33035319 31921528 1.03
tpcds_q58/duckdb:duckdb 13033199 12276566 1.06
tpcds_q59/duckdb:duckdb 35301801 35049092 1.01
tpcds_q60/duckdb:duckdb 15108512 14208701 1.06
tpcds_q61/duckdb:duckdb 14711375 14358394 1.02
tpcds_q62/duckdb:duckdb 9579947 9182004 1.04
tpcds_q63/duckdb:duckdb 12621674 12190561 1.04
tpcds_q64/duckdb:duckdb 55971971 53127923 1.05
tpcds_q65/duckdb:duckdb 35566275 34506604 1.03
tpcds_q66/duckdb:duckdb 26628978 25360772 1.05
tpcds_q67/duckdb:duckdb 131713785 127496138 1.03
tpcds_q68/duckdb:duckdb 25569877 24899758 1.03
tpcds_q69/duckdb:duckdb 24796686 25310686 0.98
tpcds_q70/duckdb:duckdb 15126731 14325001 1.06
tpcds_q71/duckdb:duckdb 🚨 13068831 11412234 1.15
tpcds_q72/duckdb:duckdb 43965923 41665517 1.06
tpcds_q73/duckdb:duckdb 11192474 10743760 1.04
tpcds_q74/duckdb:duckdb 145709090 145838304 1.00
tpcds_q75/duckdb:duckdb 41855067 41061663 1.02
tpcds_q76/duckdb:duckdb 12161224 11254598 1.08
tpcds_q77/duckdb:duckdb 13022297 12664515 1.03
tpcds_q78/duckdb:duckdb 63197048 62893626 1.00
tpcds_q79/duckdb:duckdb 19010130 18630357 1.02
tpcds_q80/duckdb:duckdb 27665469 27416336 1.01
tpcds_q81/duckdb:duckdb 🚨 40029998 35543687 1.13
tpcds_q82/duckdb:duckdb 8848121 8404909 1.05
tpcds_q83/duckdb:duckdb 🚨 9844501 8808704 1.12
tpcds_q84/duckdb:duckdb 14030025 13919305 1.01
tpcds_q85/duckdb:duckdb 24711923 23810184 1.04
tpcds_q86/duckdb:duckdb 10788452 10049913 1.07
tpcds_q87/duckdb:duckdb 🚨 35183007 31380996 1.12
tpcds_q88/duckdb:duckdb 26256459 25573700 1.03
tpcds_q89/duckdb:duckdb 14359980 14208522 1.01
tpcds_q90/duckdb:duckdb 🚨 6179293 5502084 1.12
tpcds_q91/duckdb:duckdb 🚨 13607193 11566387 1.18
tpcds_q92/duckdb:duckdb 8590733 8268082 1.04
tpcds_q93/duckdb:duckdb 21916192 21898557 1.00
tpcds_q94/duckdb:duckdb 13248001 13374288 0.99
tpcds_q95/duckdb:duckdb 129237690 128070121 1.01
tpcds_q96/duckdb:duckdb 4720792 4506309 1.05
tpcds_q97/duckdb:duckdb 30427585 29580793 1.03
tpcds_q98/duckdb:duckdb 12986193 13721815 0.95
tpcds_q99/duckdb:duckdb 16761487 16253195 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +1.7% +4.0% -2.1% +20.7% ➖ noise
1 datafusion:vortex-file-compressed +4.0% +4.0% +0.1% +19.2% ➖ noise
1 duckdb:duckdb +16.2% +4.0% +11.8% +21.5% ➖ noise
1 duckdb:vortex-compact +4.8% +4.0% +0.8% +21.8% ➖ noise
1 duckdb:vortex-file-compressed +19.6% +4.0% +15.1% +37.1% ➖ noise
2 datafusion:vortex-compact +5.5% +1.1% +4.4% +11.7% ➖ noise
2 datafusion:vortex-file-compressed +2.9% +1.1% +1.8% +11.3% ➖ noise
2 duckdb:duckdb -0.1% +1.1% -1.2% +13.6% ➖ noise
2 duckdb:vortex-compact -0.8% +1.1% -1.8% +30.2% ➖ noise
2 duckdb:vortex-file-compressed +16.6% +1.1% +15.3% +29.0% ➖ noise
3 datafusion:vortex-compact +6.9% +3.3% +3.5% +10.9% ➖ noise
3 datafusion:vortex-file-compressed +8.3% +3.3% +4.9% +16.7% ➖ noise
3 duckdb:duckdb -3.0% +3.3% -6.0% +17.7% ➖ noise
3 duckdb:vortex-compact +0.3% +3.3% -2.9% +10.9% ➖ noise
3 duckdb:vortex-file-compressed +8.3% +3.3% +4.9% +10.9% ➖ noise
4 datafusion:vortex-compact +5.8% -0.4% +6.3% +10.9% ➖ noise
4 datafusion:vortex-file-compressed +7.5% -0.4% +7.9% +10.9% ➖ noise
4 duckdb:duckdb +9.7% -0.4% +10.2% +10.9% ➖ noise
4 duckdb:vortex-compact -2.6% -0.4% -2.2% +10.9% ➖ noise
4 duckdb:vortex-file-compressed +8.2% -0.4% +8.7% +11.2% ➖ noise
5 datafusion:vortex-compact +12.7% +1.8% +10.7% +15.4% ➖ noise
5 datafusion:vortex-file-compressed +14.6% +1.8% +12.6% +10.9% 🚨 regression
5 duckdb:duckdb +8.1% +1.8% +6.2% +10.9% ➖ noise
5 duckdb:vortex-compact +4.7% +1.8% +2.9% +10.9% ➖ noise
5 duckdb:vortex-file-compressed +6.1% +1.8% +4.2% +10.9% ➖ noise
6 datafusion:vortex-compact -3.2% +1.5% -4.6% +10.9% ➖ noise
6 datafusion:vortex-file-compressed +1.0% +1.5% -0.4% +10.9% ➖ noise
6 duckdb:duckdb +9.8% +1.5% +8.2% +14.7% ➖ noise
6 duckdb:vortex-compact +4.0% +1.5% +2.5% +10.9% ➖ noise
6 duckdb:vortex-file-compressed +20.1% +1.5% +18.4% +10.9% 🚨 regression
7 datafusion:vortex-compact +7.0% -0.1% +7.1% +10.9% ➖ noise
7 datafusion:vortex-file-compressed +9.3% -0.1% +9.4% +10.9% ➖ noise
7 duckdb:duckdb +4.5% -0.1% +4.5% +19.1% ➖ noise
7 duckdb:vortex-compact -3.3% -0.1% -3.2% +13.0% ➖ noise
7 duckdb:vortex-file-compressed +31.2% -0.1% +31.3% +20.3% 🚨 regression
8 datafusion:vortex-compact +4.5% +2.7% +1.8% +10.9% ➖ noise
8 datafusion:vortex-file-compressed +6.1% +2.7% +3.3% +10.9% ➖ noise
8 duckdb:duckdb +2.5% +2.7% -0.2% +10.9% ➖ noise
8 duckdb:vortex-compact -1.4% +2.7% -3.9% +10.9% ➖ noise
8 duckdb:vortex-file-compressed -0.3% +2.7% -2.8% +10.9% ➖ noise
9 datafusion:vortex-compact +4.4% +2.6% +1.9% +10.9% ➖ noise
9 datafusion:vortex-file-compressed +7.7% +2.6% +5.0% +10.9% ➖ noise
9 duckdb:duckdb +7.8% +2.6% +5.1% +10.9% ➖ noise
9 duckdb:vortex-compact +1.9% +2.6% -0.6% +10.9% ➖ noise
9 duckdb:vortex-file-compressed -0.6% +2.6% -3.0% +10.9% ➖ noise
10 datafusion:vortex-compact +7.5% +3.1% +4.3% +10.9% ➖ noise
10 datafusion:vortex-file-compressed +11.7% +3.1% +8.4% +10.9% ➖ noise
10 duckdb:duckdb +12.1% +3.1% +8.8% +10.9% ➖ noise
10 duckdb:vortex-compact -3.0% +3.1% -5.9% +10.9% ➖ noise
10 duckdb:vortex-file-compressed +8.6% +3.1% +5.4% +10.9% ➖ noise
11 datafusion:vortex-compact +4.3% +6.9% -2.4% +10.9% ➖ noise
11 datafusion:vortex-file-compressed +6.4% +6.9% -0.5% +12.8% ➖ noise
11 duckdb:duckdb -4.0% +6.9% -10.2% +12.9% ➖ noise
11 duckdb:vortex-compact +4.1% +6.9% -2.6% +11.0% ➖ noise
11 duckdb:vortex-file-compressed +17.4% +6.9% +9.8% +10.9% ➖ noise
12 datafusion:vortex-compact +1.7% +6.5% -4.6% +13.9% ➖ noise
12 datafusion:vortex-file-compressed +8.9% +6.5% +2.2% +12.1% ➖ noise
12 duckdb:duckdb +6.4% +6.5% -0.1% +11.4% ➖ noise
12 duckdb:vortex-compact +2.0% +6.5% -4.2% +10.9% ➖ noise
12 duckdb:vortex-file-compressed +24.3% +6.5% +16.7% +10.9% 🚨 regression
13 datafusion:vortex-compact +3.6% +2.0% +1.6% +10.9% ➖ noise
13 datafusion:vortex-file-compressed +9.3% +2.0% +7.2% +10.9% ➖ noise
13 duckdb:duckdb +11.2% +2.0% +9.1% +10.9% ➖ noise
13 duckdb:vortex-compact +7.0% +2.0% +4.9% +10.9% ➖ noise
13 duckdb:vortex-file-compressed +19.6% +2.0% +17.3% +10.9% 🚨 regression
14 datafusion:vortex-compact +8.9% +2.1% +6.7% +10.9% ➖ noise
14 datafusion:vortex-file-compressed +8.4% +2.1% +6.1% +10.9% ➖ noise
14 duckdb:duckdb +6.6% +2.1% +4.4% +10.9% ➖ noise
14 duckdb:vortex-compact +6.1% +2.1% +3.9% +10.9% ➖ noise
14 duckdb:vortex-file-compressed +4.8% +2.1% +2.7% +11.7% ➖ noise
15 datafusion:vortex-compact +0.5% +1.3% -0.8% +11.8% ➖ noise
15 datafusion:vortex-file-compressed +12.3% +1.3% +10.9% +10.9% 🚨 regression
15 duckdb:duckdb +11.0% +1.3% +9.6% +10.9% ➖ noise
15 duckdb:vortex-compact +14.3% +1.3% +12.9% +14.3% ➖ noise
15 duckdb:vortex-file-compressed +4.7% +1.3% +3.4% +10.9% ➖ noise
16 datafusion:vortex-compact +1.7% +2.7% -1.0% +18.6% ➖ noise
16 datafusion:vortex-file-compressed +5.9% +2.7% +3.1% +11.8% ➖ noise
16 duckdb:duckdb +3.2% +2.7% +0.4% +14.1% ➖ noise
16 duckdb:vortex-compact +19.3% +2.7% +16.1% +14.3% 🚨 regression
16 duckdb:vortex-file-compressed +25.0% +2.7% +21.7% +20.6% 🚨 regression
17 datafusion:vortex-compact +5.0% +2.0% +3.0% +10.9% ➖ noise
17 datafusion:vortex-file-compressed +7.6% +2.0% +5.5% +10.9% ➖ noise
17 duckdb:duckdb +1.9% +2.0% -0.1% +10.9% ➖ noise
17 duckdb:vortex-compact +0.4% +2.0% -1.5% +10.9% ➖ noise
17 duckdb:vortex-file-compressed +18.4% +2.0% +16.1% +11.3% 🚨 regression
18 datafusion:vortex-compact +8.5% +1.0% +7.4% +10.9% ➖ noise
18 datafusion:vortex-file-compressed +9.0% +1.0% +8.0% +10.9% ➖ noise
18 duckdb:duckdb +10.9% +1.0% +9.8% +11.0% ➖ noise
18 duckdb:vortex-compact -0.5% +1.0% -1.5% +10.9% ➖ noise
18 duckdb:vortex-file-compressed +13.7% +1.0% +12.7% +10.9% 🚨 regression
19 datafusion:vortex-compact +8.3% +7.6% +0.7% +15.6% ➖ noise
19 datafusion:vortex-file-compressed +12.2% +7.6% +4.3% +10.9% ➖ noise
19 duckdb:duckdb +7.4% +7.6% -0.2% +10.9% ➖ noise
19 duckdb:vortex-compact +4.7% +7.6% -2.7% +10.9% ➖ noise
19 duckdb:vortex-file-compressed +6.3% +7.6% -1.1% +10.9% ➖ noise
20 datafusion:vortex-compact +7.5% +3.9% +3.4% +10.9% ➖ noise
20 datafusion:vortex-file-compressed +2.5% +3.9% -1.3% +11.0% ➖ noise
20 duckdb:duckdb +13.6% +3.9% +9.4% +10.9% ➖ noise
20 duckdb:vortex-compact +3.7% +3.9% -0.2% +10.9% ➖ noise
20 duckdb:vortex-file-compressed +5.2% +3.9% +1.2% +10.9% ➖ noise
21 datafusion:vortex-compact +12.1% -1.4% +13.7% +11.9% 🚨 regression
21 datafusion:vortex-file-compressed -0.1% -1.4% +1.3% +12.9% ➖ noise
21 duckdb:duckdb +13.7% -1.4% +15.3% +23.6% ➖ noise
21 duckdb:vortex-compact -3.2% -1.4% -1.8% +18.7% ➖ noise
21 duckdb:vortex-file-compressed +12.0% -1.4% +13.5% +12.3% 🚨 regression
22 datafusion:vortex-compact +8.3% -1.9% +10.3% +24.1% ➖ noise
22 datafusion:vortex-file-compressed +39.6% -1.9% +42.3% +30.6% 🚨 regression
22 duckdb:duckdb +15.6% -1.9% +17.8% +13.8% 🚨 regression
22 duckdb:vortex-compact -0.4% -1.9% +1.5% +12.1% ➖ noise
22 duckdb:vortex-file-compressed +17.4% -1.9% +19.6% +15.8% 🚨 regression
23 datafusion:vortex-compact +6.4% +2.4% +3.9% +10.9% ➖ noise
23 datafusion:vortex-file-compressed +3.8% +2.4% +1.4% +12.5% ➖ noise
23 duckdb:duckdb -0.3% +2.4% -2.6% +12.5% ➖ noise
23 duckdb:vortex-compact +1.3% +2.4% -1.1% +17.8% ➖ noise
23 duckdb:vortex-file-compressed +6.5% +2.4% +4.0% +12.7% ➖ noise
24 datafusion:vortex-compact +6.8% -0.1% +7.0% +10.9% ➖ noise
24 datafusion:vortex-file-compressed +6.8% -0.1% +6.9% +10.9% ➖ noise
24 duckdb:duckdb +5.8% -0.1% +5.9% +10.9% ➖ noise
24 duckdb:vortex-compact +0.2% -0.1% +0.3% +10.9% ➖ noise
24 duckdb:vortex-file-compressed +2.0% -0.1% +2.1% +12.2% ➖ noise
25 datafusion:vortex-compact +8.5% +0.6% +7.8% +10.9% ➖ noise
25 datafusion:vortex-file-compressed +9.3% +0.6% +8.6% +12.7% ➖ noise
25 duckdb:duckdb +12.3% +0.6% +11.6% +10.9% 🚨 regression
25 duckdb:vortex-compact +1.1% +0.6% +0.5% +15.1% ➖ noise
25 duckdb:vortex-file-compressed +4.8% +0.6% +4.2% +10.9% ➖ noise
26 datafusion:vortex-compact +6.4% -1.3% +7.7% +10.9% ➖ noise
26 datafusion:vortex-file-compressed +11.4% -1.3% +12.8% +17.3% ➖ noise
26 duckdb:duckdb +7.0% -1.3% +8.4% +13.0% ➖ noise
26 duckdb:vortex-compact +3.5% -1.3% +4.8% +15.2% ➖ noise
26 duckdb:vortex-file-compressed +12.4% -1.3% +13.9% +12.8% 🚨 regression
27 datafusion:vortex-compact +7.7% +0.1% +7.6% +10.9% ➖ noise
27 datafusion:vortex-file-compressed +12.8% +0.1% +12.7% +10.9% 🚨 regression
27 duckdb:duckdb +10.1% +0.1% +10.0% +19.0% ➖ noise
27 duckdb:vortex-compact -0.4% +0.1% -0.4% +10.9% ➖ noise
27 duckdb:vortex-file-compressed +19.5% +0.1% +19.4% +17.0% 🚨 regression
28 datafusion:vortex-compact +2.2% -0.1% +2.3% +10.9% ➖ noise
28 datafusion:vortex-file-compressed +2.5% -0.1% +2.7% +10.9% ➖ noise
28 duckdb:duckdb +7.6% -0.1% +7.8% +10.9% ➖ noise
28 duckdb:vortex-compact +0.4% -0.1% +0.5% +10.9% ➖ noise
28 duckdb:vortex-file-compressed +4.0% -0.1% +4.1% +11.5% ➖ noise
29 datafusion:vortex-compact +7.1% -0.5% +7.7% +11.0% ➖ noise
29 datafusion:vortex-file-compressed +4.3% -0.5% +4.9% +10.9% ➖ noise
29 duckdb:duckdb +8.6% -0.5% +9.2% +10.9% ➖ noise
29 duckdb:vortex-compact +3.0% -0.5% +3.6% +10.9% ➖ noise
29 duckdb:vortex-file-compressed +5.7% -0.5% +6.2% +10.9% ➖ noise
30 datafusion:vortex-compact +9.9% +4.4% +5.3% +12.5% ➖ noise
30 datafusion:vortex-file-compressed +10.1% +4.4% +5.5% +10.9% ➖ noise
30 duckdb:duckdb +3.5% +4.4% -0.8% +11.6% ➖ noise
30 duckdb:vortex-compact -1.1% +4.4% -5.3% +21.9% ➖ noise
30 duckdb:vortex-file-compressed +19.7% +4.4% +14.7% +12.4% 🚨 regression
31 datafusion:vortex-compact +8.6% -1.5% +10.3% +10.9% ➖ noise
31 datafusion:vortex-file-compressed +10.7% -1.5% +12.4% +10.9% 🚨 regression
31 duckdb:duckdb +9.6% -1.5% +11.3% +10.9% 🚨 regression
31 duckdb:vortex-compact +0.3% -1.5% +1.8% +10.9% ➖ noise
31 duckdb:vortex-file-compressed +18.1% -1.5% +19.9% +11.7% 🚨 regression
32 datafusion:vortex-compact -5.6% +7.2% -11.9% +18.7% ➖ noise
32 datafusion:vortex-file-compressed +10.0% +7.2% +2.6% +18.4% ➖ noise
32 duckdb:duckdb +25.8% +7.2% +17.4% +14.1% 🚨 regression
32 duckdb:vortex-compact +8.8% +7.2% +1.5% +10.9% ➖ noise
32 duckdb:vortex-file-compressed +23.6% +7.2% +15.4% +10.9% 🚨 regression
33 datafusion:vortex-compact -3.0% -1.8% -1.3% +10.9% ➖ noise
33 datafusion:vortex-file-compressed +9.3% -1.8% +11.3% +10.9% 🚨 regression
33 duckdb:duckdb +10.1% -1.8% +12.1% +10.9% 🚨 regression
33 duckdb:vortex-compact +6.5% -1.8% +8.5% +10.9% ➖ noise
33 duckdb:vortex-file-compressed +7.2% -1.8% +9.1% +11.5% ➖ noise
34 datafusion:vortex-compact +0.3% -1.0% +1.3% +10.9% ➖ noise
34 datafusion:vortex-file-compressed +8.7% -1.0% +9.8% +11.8% ➖ noise
34 duckdb:duckdb +7.0% -1.0% +8.1% +10.9% ➖ noise
34 duckdb:vortex-compact +0.0% -1.0% +1.0% +11.3% ➖ noise
34 duckdb:vortex-file-compressed +2.0% -1.0% +3.0% +10.9% ➖ noise
35 datafusion:vortex-compact +0.7% +4.6% -3.7% +10.9% ➖ noise
35 datafusion:vortex-file-compressed +7.1% +4.6% +2.4% +10.9% ➖ noise
35 duckdb:duckdb +11.5% +4.6% +6.6% +12.5% ➖ noise
35 duckdb:vortex-compact +1.9% +4.6% -2.5% +10.9% ➖ noise
35 duckdb:vortex-file-compressed +11.5% +4.6% +6.6% +12.0% ➖ noise
36 datafusion:vortex-compact +2.5% +1.3% +1.1% +10.9% ➖ noise
36 datafusion:vortex-file-compressed +1.4% +1.3% +0.1% +11.5% ➖ noise
36 duckdb:duckdb +8.6% +1.3% +7.2% +10.9% ➖ noise
36 duckdb:vortex-compact +4.0% +1.3% +2.7% +11.0% ➖ noise
36 duckdb:vortex-file-compressed +9.2% +1.3% +7.8% +10.9% ➖ noise
37 datafusion:vortex-compact +4.2% -0.6% +4.9% +10.9% ➖ noise
37 datafusion:vortex-file-compressed +15.3% -0.6% +16.0% +13.6% 🚨 regression
37 duckdb:duckdb -1.1% -0.6% -0.4% +14.1% ➖ noise
37 duckdb:vortex-compact +8.9% -0.6% +9.6% +14.7% ➖ noise
37 duckdb:vortex-file-compressed +26.5% -0.6% +27.3% +10.9% 🚨 regression
38 datafusion:vortex-compact +1.5% -2.1% +3.6% +10.9% ➖ noise
38 datafusion:vortex-file-compressed +13.0% -2.1% +15.4% +10.9% 🚨 regression
38 duckdb:duckdb -0.6% -2.1% +1.5% +10.9% ➖ noise
38 duckdb:vortex-compact -2.1% -2.1% -0.0% +10.9% ➖ noise
38 duckdb:vortex-file-compressed +8.2% -2.1% +10.5% +22.3% ➖ noise
39 datafusion:vortex-compact -1.4% +2.7% -3.9% +12.4% ➖ noise
39 datafusion:vortex-file-compressed +13.0% +2.7% +10.0% +11.3% ➖ noise
39 duckdb:duckdb +11.3% +2.7% +8.4% +11.3% ➖ noise
39 duckdb:vortex-compact -2.1% +2.7% -4.7% +20.4% ➖ noise
39 duckdb:vortex-file-compressed +3.6% +2.7% +0.9% +11.4% ➖ noise
40 datafusion:vortex-compact +1.0% +2.0% -1.0% +10.9% ➖ noise
40 datafusion:vortex-file-compressed +9.0% +2.0% +6.9% +10.9% ➖ noise
40 duckdb:duckdb +2.9% +2.0% +0.8% +13.1% ➖ noise
40 duckdb:vortex-compact +4.4% +2.0% +2.3% +14.6% ➖ noise
40 duckdb:vortex-file-compressed +17.6% +2.0% +15.3% +13.1% 🚨 regression
41 datafusion:vortex-compact +5.9% +3.8% +2.0% +10.9% ➖ noise
41 datafusion:vortex-file-compressed +15.2% +3.8% +11.0% +10.9% 🚨 regression
41 duckdb:duckdb +10.4% +3.8% +6.4% +12.2% ➖ noise
41 duckdb:vortex-compact +12.6% +3.8% +8.5% +10.9% ➖ noise
41 duckdb:vortex-file-compressed +19.8% +3.8% +15.4% +10.9% 🚨 regression
42 datafusion:vortex-compact -1.6% +11.1% -11.4% +13.7% ➖ noise
42 datafusion:vortex-file-compressed +11.6% +11.1% +0.4% +25.8% ➖ noise
42 duckdb:duckdb +7.5% +11.1% -3.2% +17.2% ➖ noise
42 duckdb:vortex-compact +6.9% +11.1% -3.8% +14.4% ➖ noise
42 duckdb:vortex-file-compressed +2.9% +11.1% -7.4% +14.4% ➖ noise
43 datafusion:vortex-compact +1.8% +2.5% -0.7% +10.9% ➖ noise
43 datafusion:vortex-file-compressed +3.9% +2.5% +1.3% +10.9% ➖ noise
43 duckdb:duckdb +12.3% +2.5% +9.5% +10.9% ➖ noise
43 duckdb:vortex-compact -0.6% +2.5% -3.1% +19.9% ➖ noise
43 duckdb:vortex-file-compressed +13.0% +2.5% +10.2% +10.9% ➖ noise
44 datafusion:vortex-compact +1.7% +1.2% +0.5% +10.9% ➖ noise
44 datafusion:vortex-file-compressed -2.0% +1.2% -3.2% +14.3% ➖ noise
44 duckdb:duckdb -3.8% +1.2% -5.0% +12.8% ➖ noise
44 duckdb:vortex-compact -5.0% +1.2% -6.2% +13.5% ➖ noise
44 duckdb:vortex-file-compressed +11.3% +1.2% +9.9% +10.9% ➖ noise
45 datafusion:vortex-compact +6.2% +1.6% +4.5% +10.9% ➖ noise
45 datafusion:vortex-file-compressed +0.2% +1.6% -1.5% +10.9% ➖ noise
45 duckdb:duckdb +11.5% +1.6% +9.7% +10.9% ➖ noise
45 duckdb:vortex-compact -1.0% +1.6% -2.6% +11.8% ➖ noise
45 duckdb:vortex-file-compressed +5.2% +1.6% +3.5% +15.0% ➖ noise
46 datafusion:vortex-compact +0.3% +3.2% -2.8% +12.9% ➖ noise
46 datafusion:vortex-file-compressed +2.7% +3.2% -0.5% +11.0% ➖ noise
46 duckdb:duckdb +3.9% +3.2% +0.7% +10.9% ➖ noise
46 duckdb:vortex-compact +4.4% +3.2% +1.2% +10.9% ➖ noise
46 duckdb:vortex-file-compressed +7.5% +3.2% +4.2% +12.2% ➖ noise
47 datafusion:vortex-compact +2.6% -0.2% +2.8% +10.9% ➖ noise
47 datafusion:vortex-file-compressed +10.6% -0.2% +10.8% +10.9% ➖ noise
47 duckdb:duckdb +1.8% -0.2% +2.0% +10.9% ➖ noise
47 duckdb:vortex-compact +1.8% -0.2% +2.1% +10.9% ➖ noise
47 duckdb:vortex-file-compressed +11.5% -0.2% +11.8% +10.9% 🚨 regression
48 datafusion:vortex-compact +1.3% -0.2% +1.4% +10.9% ➖ noise
48 datafusion:vortex-file-compressed +8.3% -0.2% +8.4% +10.9% ➖ noise
48 duckdb:duckdb +2.3% -0.2% +2.5% +10.9% ➖ noise
48 duckdb:vortex-compact +0.3% -0.2% +0.4% +10.9% ➖ noise
48 duckdb:vortex-file-compressed +14.6% -0.2% +14.8% +10.9% 🚨 regression
49 datafusion:vortex-compact +4.7% +1.5% +3.1% +10.9% ➖ noise
49 datafusion:vortex-file-compressed +9.6% +1.5% +7.9% +10.9% ➖ noise
49 duckdb:duckdb +4.1% +1.5% +2.5% +10.9% ➖ noise
49 duckdb:vortex-compact +6.2% +1.5% +4.6% +11.2% ➖ noise
49 duckdb:vortex-file-compressed +3.4% +1.5% +1.8% +13.5% ➖ noise
50 datafusion:vortex-compact +2.6% +0.9% +1.7% +13.1% ➖ noise
50 datafusion:vortex-file-compressed +9.6% +0.9% +8.6% +11.1% ➖ noise
50 duckdb:duckdb +0.9% +0.9% -0.1% +12.4% ➖ noise
50 duckdb:vortex-compact +3.9% +0.9% +3.0% +11.1% ➖ noise
50 duckdb:vortex-file-compressed -3.0% +0.9% -3.9% +14.0% ➖ noise
51 datafusion:vortex-compact +3.3% -1.4% +4.7% +10.9% ➖ noise
51 datafusion:vortex-file-compressed -1.0% -1.4% +0.3% +11.8% ➖ noise
51 duckdb:duckdb +1.8% -1.4% +3.2% +18.7% ➖ noise
51 duckdb:vortex-compact +5.0% -1.4% +6.5% +14.9% ➖ noise
51 duckdb:vortex-file-compressed +6.3% -1.4% +7.8% +20.8% ➖ noise
52 datafusion:vortex-compact +5.7% -1.2% +7.0% +13.8% ➖ noise
52 datafusion:vortex-file-compressed +8.1% -1.2% +9.4% +13.9% ➖ noise
52 duckdb:duckdb +7.4% -1.2% +8.7% +16.5% ➖ noise
52 duckdb:vortex-compact +8.1% -1.2% +9.5% +12.3% ➖ noise
52 duckdb:vortex-file-compressed +17.4% -1.2% +18.8% +24.8% ➖ noise
53 datafusion:vortex-compact +3.9% +4.0% -0.1% +10.9% ➖ noise
53 datafusion:vortex-file-compressed +8.8% +4.0% +4.6% +10.9% ➖ noise
53 duckdb:duckdb +6.2% +4.0% +2.1% +10.9% ➖ noise
53 duckdb:vortex-compact +3.0% +4.0% -0.9% +12.2% ➖ noise
53 duckdb:vortex-file-compressed +10.9% +4.0% +6.7% +10.9% ➖ noise
54 datafusion:vortex-compact +0.9% -0.3% +1.2% +10.9% ➖ noise
54 datafusion:vortex-file-compressed +10.7% -0.3% +11.0% +10.9% 🚨 regression
54 duckdb:duckdb +12.4% -0.3% +12.7% +13.4% ➖ noise
54 duckdb:vortex-compact +1.3% -0.3% +1.6% +11.0% ➖ noise
54 duckdb:vortex-file-compressed -0.2% -0.3% +0.1% +15.2% ➖ noise
55 datafusion:vortex-compact -0.2% +2.4% -2.5% +10.9% ➖ noise
55 datafusion:vortex-file-compressed +16.3% +2.4% +13.7% +15.0% ➖ noise
55 duckdb:duckdb +6.2% +2.4% +3.7% +14.9% ➖ noise
55 duckdb:vortex-compact +7.2% +2.4% +4.8% +10.9% ➖ noise
55 duckdb:vortex-file-compressed +9.5% +2.4% +7.0% +12.5% ➖ noise
56 datafusion:vortex-compact +7.0% +0.9% +6.0% +10.9% ➖ noise
56 datafusion:vortex-file-compressed +12.6% +0.9% +11.6% +10.9% 🚨 regression
56 duckdb:duckdb +8.9% +0.9% +7.9% +10.9% ➖ noise
56 duckdb:vortex-compact +9.6% +0.9% +8.6% +16.7% ➖ noise
56 duckdb:vortex-file-compressed +7.8% +0.9% +6.8% +10.9% ➖ noise
57 datafusion:vortex-compact -0.7% +0.5% -1.2% +12.2% ➖ noise
57 datafusion:vortex-file-compressed +3.5% +0.5% +2.9% +11.6% ➖ noise
57 duckdb:duckdb +3.5% +0.5% +2.9% +13.3% ➖ noise
57 duckdb:vortex-compact +2.5% +0.5% +1.9% +11.6% ➖ noise
57 duckdb:vortex-file-compressed +10.2% +0.5% +9.6% +14.5% ➖ noise
58 datafusion:vortex-compact -0.9% +3.5% -4.2% +10.9% ➖ noise
58 datafusion:vortex-file-compressed +3.9% +3.5% +0.4% +10.9% ➖ noise
58 duckdb:duckdb +6.2% +3.5% +2.6% +11.0% ➖ noise
58 duckdb:vortex-compact -6.9% +3.5% -10.0% +11.5% ➖ noise
58 duckdb:vortex-file-compressed +10.4% +3.5% +6.7% +19.8% ➖ noise
59 datafusion:vortex-compact +0.4% +0.2% +0.1% +10.9% ➖ noise
59 datafusion:vortex-file-compressed +6.3% +0.2% +6.1% +10.9% ➖ noise
59 duckdb:duckdb +0.7% +0.2% +0.5% +10.9% ➖ noise
59 duckdb:vortex-compact +5.7% +0.2% +5.4% +15.5% ➖ noise
59 duckdb:vortex-file-compressed -0.9% +0.2% -1.2% +10.9% ➖ noise
60 datafusion:vortex-compact +1.6% -2.4% +4.1% +12.6% ➖ noise
60 datafusion:vortex-file-compressed +8.0% -2.4% +10.7% +10.9% ➖ noise
60 duckdb:duckdb +6.3% -2.4% +9.0% +11.9% ➖ noise
60 duckdb:vortex-compact +10.0% -2.4% +12.7% +11.4% 🚨 regression
60 duckdb:vortex-file-compressed +6.9% -2.4% +9.6% +11.0% ➖ noise
61 datafusion:vortex-compact +1.0% +4.5% -3.3% +10.9% ➖ noise
61 datafusion:vortex-file-compressed +11.8% +4.5% +7.0% +10.9% ➖ noise
61 duckdb:duckdb +2.5% +4.5% -2.0% +10.9% ➖ noise
61 duckdb:vortex-compact +8.7% +4.5% +4.0% +10.9% ➖ noise
61 duckdb:vortex-file-compressed +3.9% +4.5% -0.6% +12.2% ➖ noise
62 datafusion:vortex-compact +7.1% -5.6% +13.5% +31.9% ➖ noise
62 datafusion:vortex-file-compressed +34.9% -5.6% +42.9% +25.6% 🚨 regression
62 duckdb:duckdb +4.3% -5.6% +10.5% +15.0% ➖ noise
62 duckdb:vortex-compact -1.8% -5.6% +4.0% +23.3% ➖ noise
62 duckdb:vortex-file-compressed +12.8% -5.6% +19.5% +15.7% 🚨 regression
63 datafusion:vortex-compact +3.6% +1.8% +1.8% +10.9% ➖ noise
63 datafusion:vortex-file-compressed +10.3% +1.8% +8.4% +10.9% ➖ noise
63 duckdb:duckdb +3.5% +1.8% +1.8% +10.9% ➖ noise
63 duckdb:vortex-compact +4.1% +1.8% +2.3% +10.9% ➖ noise
63 duckdb:vortex-file-compressed +15.3% +1.8% +13.3% +10.9% 🚨 regression
64 datafusion:vortex-compact +4.1% -0.3% +4.3% +10.9% ➖ noise
64 datafusion:vortex-file-compressed +8.2% -0.3% +8.5% +10.9% ➖ noise
64 duckdb:duckdb +5.4% -0.3% +5.6% +10.9% ➖ noise
64 duckdb:vortex-compact +6.4% -0.3% +6.7% +10.9% ➖ noise
64 duckdb:vortex-file-compressed +7.2% -0.3% +7.5% +10.9% ➖ noise
65 datafusion:vortex-compact +5.8% +8.0% -2.0% +10.9% ➖ noise
65 datafusion:vortex-file-compressed +8.0% +8.0% -0.0% +10.9% ➖ noise
65 duckdb:duckdb +3.1% +8.0% -4.6% +14.3% ➖ noise
65 duckdb:vortex-compact +2.5% +8.0% -5.1% +20.8% ➖ noise
65 duckdb:vortex-file-compressed -0.4% +8.0% -7.8% +11.6% ➖ noise
66 datafusion:vortex-compact +4.9% -2.0% +7.1% +10.9% ➖ noise
66 datafusion:vortex-file-compressed +11.2% -2.0% +13.5% +13.0% 🚨 regression
66 duckdb:duckdb +5.0% -2.0% +7.2% +10.9% ➖ noise
66 duckdb:vortex-compact +10.9% -2.0% +13.2% +12.0% 🚨 regression
66 duckdb:vortex-file-compressed +15.8% -2.0% +18.2% +14.3% 🚨 regression
67 datafusion:vortex-compact +8.7% +4.0% +4.5% +10.9% ➖ noise
67 datafusion:vortex-file-compressed +4.9% +4.0% +0.8% +10.9% ➖ noise
67 duckdb:duckdb +3.3% +4.0% -0.7% +10.9% ➖ noise
67 duckdb:vortex-compact +7.2% +4.0% +3.0% +10.9% ➖ noise
67 duckdb:vortex-file-compressed +6.4% +4.0% +2.3% +10.9% ➖ noise
68 datafusion:vortex-compact -4.2% +3.5% -7.4% +14.7% ➖ noise
68 datafusion:vortex-file-compressed -5.1% +3.5% -8.3% +14.2% ➖ noise
68 duckdb:duckdb +2.7% +3.5% -0.8% +10.9% ➖ noise
68 duckdb:vortex-compact +2.7% +3.5% -0.8% +10.9% ➖ noise
68 duckdb:vortex-file-compressed +14.5% +3.5% +10.7% +10.9% ➖ noise
69 datafusion:vortex-compact +6.5% +6.0% +0.5% +10.9% ➖ noise
69 datafusion:vortex-file-compressed +8.2% +6.0% +2.0% +10.9% ➖ noise
69 duckdb:duckdb -2.0% +6.0% -7.6% +14.0% ➖ noise
69 duckdb:vortex-compact +8.1% +6.0% +1.9% +10.9% ➖ noise
69 duckdb:vortex-file-compressed +2.3% +6.0% -3.6% +11.6% ➖ noise
70 datafusion:vortex-compact +6.3% -1.3% +7.7% +10.9% ➖ noise
70 datafusion:vortex-file-compressed +12.3% -1.3% +13.7% +10.9% 🚨 regression
70 duckdb:duckdb +5.6% -1.3% +7.0% +13.6% ➖ noise
70 duckdb:vortex-compact +3.2% -1.3% +4.6% +10.9% ➖ noise
70 duckdb:vortex-file-compressed +13.8% -1.3% +15.3% +12.4% 🚨 regression
71 datafusion:vortex-compact +1.7% +11.0% -8.4% +13.2% ➖ noise
71 datafusion:vortex-file-compressed +7.7% +11.0% -3.0% +15.3% ➖ noise
71 duckdb:duckdb +14.5% +11.0% +3.2% +12.9% ➖ noise
71 duckdb:vortex-compact +1.7% +11.0% -8.4% +17.6% ➖ noise
71 duckdb:vortex-file-compressed +21.4% +11.0% +9.4% +10.9% ➖ noise
72 datafusion:vortex-compact +10.3% +7.6% +2.5% +10.9% ➖ noise
72 datafusion:vortex-file-compressed +10.9% +7.6% +3.0% +10.9% ➖ noise
72 duckdb:duckdb +5.5% +7.6% -2.0% +10.9% ➖ noise
72 duckdb:vortex-compact +1.1% +7.6% -6.1% +10.9% ➖ noise
72 duckdb:vortex-file-compressed +6.5% +7.6% -1.1% +10.9% ➖ noise
73 datafusion:vortex-compact +4.5% +4.3% +0.2% +10.9% ➖ noise
73 datafusion:vortex-file-compressed +9.4% +4.3% +4.9% +10.9% ➖ noise
73 duckdb:duckdb +4.2% +4.3% -0.1% +11.3% ➖ noise
73 duckdb:vortex-compact +1.3% +4.3% -2.8% +13.6% ➖ noise
73 duckdb:vortex-file-compressed +18.1% +4.3% +13.3% +10.9% 🚨 regression
74 datafusion:vortex-compact +6.4% +4.7% +1.7% +10.9% ➖ noise
74 datafusion:vortex-file-compressed +6.4% +4.7% +1.6% +10.9% ➖ noise
74 duckdb:duckdb -0.1% +4.7% -4.6% +10.9% ➖ noise
74 duckdb:vortex-compact +2.9% +4.7% -1.7% +20.6% ➖ noise
74 duckdb:vortex-file-compressed +5.0% +4.7% +0.3% +11.5% ➖ noise
75 datafusion:vortex-compact +4.1% +9.1% -4.7% +10.9% ➖ noise
75 datafusion:vortex-file-compressed +5.9% +9.1% -3.0% +11.0% ➖ noise
75 duckdb:duckdb +1.9% +9.1% -6.6% +10.9% ➖ noise
75 duckdb:vortex-compact +5.5% +9.1% -3.3% +14.6% ➖ noise
75 duckdb:vortex-file-compressed +2.3% +9.1% -6.3% +11.2% ➖ noise
76 datafusion:vortex-compact +4.5% +5.9% -1.4% +10.9% ➖ noise
76 datafusion:vortex-file-compressed +9.8% +5.9% +3.7% +10.9% ➖ noise
76 duckdb:duckdb +8.1% +5.9% +2.0% +16.9% ➖ noise
76 duckdb:vortex-compact +6.5% +5.9% +0.5% +10.9% ➖ noise
76 duckdb:vortex-file-compressed +16.5% +5.9% +10.0% +10.9% ➖ noise
77 datafusion:vortex-compact +1.0% +5.6% -4.4% +10.9% ➖ noise
77 datafusion:vortex-file-compressed +10.0% +5.6% +4.1% +10.9% ➖ noise
77 duckdb:duckdb +2.8% +5.6% -2.7% +10.9% ➖ noise
77 duckdb:vortex-compact +6.2% +5.6% +0.6% +15.9% ➖ noise
77 duckdb:vortex-file-compressed +18.2% +5.6% +11.9% +19.5% ➖ noise
78 datafusion:vortex-compact +6.6% +9.2% -2.4% +10.9% ➖ noise
78 datafusion:vortex-file-compressed +11.4% +9.2% +2.0% +10.9% ➖ noise
78 duckdb:duckdb +0.5% +9.2% -8.0% +10.9% ➖ noise
78 duckdb:vortex-compact +7.1% +9.2% -2.0% +13.2% ➖ noise
78 duckdb:vortex-file-compressed +1.7% +9.2% -6.9% +12.6% ➖ noise
79 datafusion:vortex-compact -1.5% +8.6% -9.3% +10.9% ➖ noise
79 datafusion:vortex-file-compressed +13.8% +8.6% +4.8% +10.9% ➖ noise
79 duckdb:duckdb +2.0% +8.6% -6.0% +10.9% ➖ noise
79 duckdb:vortex-compact +7.1% +8.6% -1.4% +10.9% ➖ noise
79 duckdb:vortex-file-compressed +4.3% +8.6% -3.9% +10.9% ➖ noise
80 datafusion:vortex-compact +6.5% +6.9% -0.4% +10.9% ➖ noise
80 datafusion:vortex-file-compressed +11.8% +6.9% +4.6% +10.9% ➖ noise
80 duckdb:duckdb +0.9% +6.9% -5.6% +10.9% ➖ noise
80 duckdb:vortex-compact +19.1% +6.9% +11.4% +14.5% ➖ noise
80 duckdb:vortex-file-compressed +22.6% +6.9% +14.6% +10.9% 🚨 regression
81 datafusion:vortex-compact +7.9% +9.5% -1.5% +18.6% ➖ noise
81 datafusion:vortex-file-compressed +14.3% +9.5% +4.4% +10.9% ➖ noise
81 duckdb:duckdb +12.6% +9.5% +2.8% +10.9% ➖ noise
81 duckdb:vortex-compact +4.5% +9.5% -4.6% +11.1% ➖ noise
81 duckdb:vortex-file-compressed +10.8% +9.5% +1.2% +10.9% ➖ noise
82 datafusion:vortex-compact -1.2% +9.4% -9.7% +10.9% ➖ noise
82 datafusion:vortex-file-compressed +12.3% +9.4% +2.6% +18.1% ➖ noise
82 duckdb:duckdb +5.3% +9.4% -3.8% +12.3% ➖ noise
82 duckdb:vortex-compact +11.8% +9.4% +2.2% +19.2% ➖ noise
82 duckdb:vortex-file-compressed +8.9% +9.4% -0.5% +10.9% ➖ noise
83 datafusion:vortex-compact -0.0% +9.3% -8.5% +10.9% ➖ noise
83 datafusion:vortex-file-compressed +6.1% +9.3% -3.0% +10.9% ➖ noise
83 duckdb:duckdb +11.8% +9.3% +2.2% +10.9% ➖ noise
83 duckdb:vortex-compact +18.7% +9.3% +8.6% +18.2% ➖ noise
83 duckdb:vortex-file-compressed +11.6% +9.3% +2.1% +10.9% ➖ noise
84 datafusion:vortex-compact +7.2% +5.3% +1.8% +13.4% ➖ noise
84 datafusion:vortex-file-compressed +15.4% +5.3% +9.5% +10.9% ➖ noise
84 duckdb:duckdb +0.8% +5.3% -4.3% +10.9% ➖ noise
84 duckdb:vortex-compact +8.7% +5.3% +3.2% +10.9% ➖ noise
84 duckdb:vortex-file-compressed +17.0% +5.3% +11.1% +11.4% ➖ noise
85 datafusion:vortex-compact +3.9% +7.8% -3.6% +11.6% ➖ noise
85 datafusion:vortex-file-compressed +13.3% +7.8% +5.1% +10.9% ➖ noise
85 duckdb:duckdb +3.8% +7.8% -3.7% +10.9% ➖ noise
85 duckdb:vortex-compact +15.0% +7.8% +6.7% +10.9% ➖ noise
85 duckdb:vortex-file-compressed +19.9% +7.8% +11.3% +10.9% 🚨 regression
86 datafusion:vortex-compact -7.6% +8.9% -15.1% +19.2% ➖ noise
86 datafusion:vortex-file-compressed +18.7% +8.9% +9.0% +13.7% ➖ noise
86 duckdb:duckdb +7.3% +8.9% -1.4% +14.2% ➖ noise
86 duckdb:vortex-compact +4.1% +8.9% -4.4% +13.6% ➖ noise
86 duckdb:vortex-file-compressed +6.1% +8.9% -2.5% +14.4% ➖ noise
87 datafusion:vortex-compact +4.0% +10.7% -6.0% +10.9% ➖ noise
87 datafusion:vortex-file-compressed +0.6% +10.7% -9.1% +10.9% ➖ noise
87 duckdb:duckdb +12.1% +10.7% +1.3% +10.9% ➖ noise
87 duckdb:vortex-compact +5.1% +10.7% -5.1% +11.0% ➖ noise
87 duckdb:vortex-file-compressed +0.1% +10.7% -9.5% +10.9% ➖ noise
88 datafusion:vortex-compact +1.2% +3.5% -2.3% +10.9% ➖ noise
88 datafusion:vortex-file-compressed +7.9% +3.5% +4.2% +10.9% ➖ noise
88 duckdb:duckdb +2.7% +3.5% -0.8% +10.9% ➖ noise
88 duckdb:vortex-compact +6.0% +3.5% +2.4% +10.9% ➖ noise
88 duckdb:vortex-file-compressed +7.0% +3.5% +3.4% +10.9% ➖ noise
89 datafusion:vortex-compact +2.6% +5.4% -2.6% +10.9% ➖ noise
89 datafusion:vortex-file-compressed +9.6% +5.4% +4.0% +10.9% ➖ noise
89 duckdb:duckdb +1.1% +5.4% -4.1% +11.1% ➖ noise
89 duckdb:vortex-compact +6.4% +5.4% +1.0% +10.9% ➖ noise
89 duckdb:vortex-file-compressed -3.5% +5.4% -8.4% +18.6% ➖ noise
90 datafusion:vortex-compact +5.8% +2.8% +2.9% +11.9% ➖ noise
90 datafusion:vortex-file-compressed +5.5% +2.8% +2.6% +21.0% ➖ noise
90 duckdb:duckdb +12.3% +2.8% +9.2% +13.5% ➖ noise
90 duckdb:vortex-compact +7.8% +2.8% +4.9% +15.0% ➖ noise
90 duckdb:vortex-file-compressed +10.0% +2.8% +7.0% +10.9% ➖ noise
91 datafusion:vortex-compact -0.6% +6.2% -6.4% +10.9% ➖ noise
91 datafusion:vortex-file-compressed +17.3% +6.2% +10.4% +10.9% ➖ noise
91 duckdb:duckdb +17.6% +6.2% +10.8% +26.7% ➖ noise
91 duckdb:vortex-compact +2.2% +6.2% -3.8% +10.9% ➖ noise
91 duckdb:vortex-file-compressed +3.7% +6.2% -2.4% +10.9% ➖ noise
92 datafusion:vortex-compact +6.4% +10.7% -3.9% +14.0% ➖ noise
92 datafusion:vortex-file-compressed +19.2% +10.7% +7.7% +10.9% ➖ noise
92 duckdb:duckdb +3.9% +10.7% -6.2% +10.9% ➖ noise
92 duckdb:vortex-compact -7.1% +10.7% -16.1% +18.5% ✅ faster
92 duckdb:vortex-file-compressed +24.4% +10.7% +12.3% +14.2% ➖ noise
93 datafusion:vortex-compact +7.6% +13.8% -5.5% +10.9% ➖ noise
93 datafusion:vortex-file-compressed +16.1% +13.8% +2.0% +10.9% ➖ noise
93 duckdb:duckdb +0.1% +13.8% -12.1% +11.7% ✅ faster
93 duckdb:vortex-compact +10.4% +13.8% -3.0% +15.9% ➖ noise
93 duckdb:vortex-file-compressed +7.7% +13.8% -5.4% +13.9% ➖ noise
94 datafusion:vortex-compact +5.2% +13.3% -7.2% +11.6% ➖ noise
94 datafusion:vortex-file-compressed -2.3% +13.3% -13.7% +19.7% ➖ noise
94 duckdb:duckdb -0.9% +13.3% -12.5% +11.6% ✅ faster
94 duckdb:vortex-compact +28.3% +13.3% +13.2% +10.9% 🚨 regression
94 duckdb:vortex-file-compressed +4.0% +13.3% -8.2% +11.3% ➖ noise
95 datafusion:vortex-compact +5.9% +14.6% -7.6% +11.3% ➖ noise
95 datafusion:vortex-file-compressed +5.4% +14.6% -8.0% +13.4% ➖ noise
95 duckdb:duckdb +0.9% +14.6% -11.9% +19.1% ➖ noise
95 duckdb:vortex-compact -0.8% +14.6% -13.4% +20.5% ➖ noise
95 duckdb:vortex-file-compressed +0.4% +14.6% -12.4% +14.1% ✅ faster
96 datafusion:vortex-compact +3.0% +8.6% -5.2% +10.9% ➖ noise
96 datafusion:vortex-file-compressed +6.8% +8.6% -1.7% +10.9% ➖ noise
96 duckdb:duckdb +4.8% +8.6% -3.5% +14.5% ➖ noise
96 duckdb:vortex-compact -4.0% +8.6% -11.5% +13.1% ➖ noise
96 duckdb:vortex-file-compressed -8.9% +8.6% -16.1% +25.8% ➖ noise
97 datafusion:vortex-compact +0.2% +11.7% -10.3% +10.9% ✅ faster
97 datafusion:vortex-file-compressed +1.5% +11.7% -9.1% +12.8% ➖ noise
97 duckdb:duckdb +2.9% +11.7% -7.9% +10.9% ➖ noise
97 duckdb:vortex-compact +6.5% +11.7% -4.6% +17.5% ➖ noise
97 duckdb:vortex-file-compressed +1.0% +11.7% -9.6% +17.1% ➖ noise
98 datafusion:vortex-compact +0.9% +8.5% -7.0% +13.5% ➖ noise
98 datafusion:vortex-file-compressed -0.6% +8.5% -8.4% +10.9% ➖ noise
98 duckdb:duckdb -5.4% +8.5% -12.8% +14.4% ✅ faster
98 duckdb:vortex-compact +16.7% +8.5% +7.6% +10.9% ➖ noise
98 duckdb:vortex-file-compressed +6.4% +8.5% -1.9% +14.5% ➖ noise
99 datafusion:vortex-compact -9.6% +9.1% -17.1% +17.2% ✅ faster
99 datafusion:vortex-file-compressed -5.9% +9.1% -13.7% +20.8% ➖ noise
99 duckdb:duckdb +3.1% +9.1% -5.4% +18.8% ➖ noise
99 duckdb:vortex-compact +10.3% +9.1% +1.2% +14.8% ➖ noise
99 duckdb:vortex-file-compressed +5.8% +9.1% -3.0% +13.9% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 25, 2026

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 25, 2026 •
edited
Loading

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +6.8%
Vortex (geomean): 1.000x ➖
Parquet (geomean): 0.937x ➖
Shifts: Parquet (control) -6.3% · Median polish -0.3%

datafusion / vortex-file-compressed (1.018x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 35810915 33123049 1.08
fineweb_q01/datafusion:vortex-file-compressed 600646534 536107498 1.12
fineweb_q02/datafusion:vortex-file-compressed 417695776 440989626 0.95
fineweb_q03/datafusion:vortex-file-compressed 1477967739 1376489105 1.07
fineweb_q04/datafusion:vortex-file-compressed 1369582717 1370664092 1.00
fineweb_q05/datafusion:vortex-file-compressed 1361710335 1354760489 1.01
fineweb_q06/datafusion:vortex-file-compressed 1539984045 1514895864 1.02
fineweb_q07/datafusion:vortex-file-compressed 1359809440 1381037320 0.98
fineweb_q08/datafusion:vortex-file-compressed 533654332 564738367 0.94
datafusion / vortex-compact (0.990x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 33127607 35906144 0.92
fineweb_q01/datafusion:vortex-compact 522764187 472981915 1.11
fineweb_q02/datafusion:vortex-compact 548892408 563974893 0.97
fineweb_q03/datafusion:vortex-compact 1467012340 1479677060 0.99
fineweb_q04/datafusion:vortex-compact 1813935346 1725931666 1.05
fineweb_q05/datafusion:vortex-compact 1464829377 1426068576 1.03
fineweb_q06/datafusion:vortex-compact 1313926485 1361308784 0.97
fineweb_q07/datafusion:vortex-compact 1242791721 1236840465 1.00
fineweb_q08/datafusion:vortex-compact 391544297 441332048 0.89
datafusion / parquet (0.926x ➖, 1↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚀 1120807384 1684054582 0.67
fineweb_q01/datafusion:parquet 1687011054 1683824235 1.00
fineweb_q02/datafusion:parquet 1637310649 1698688754 0.96
fineweb_q03/datafusion:parquet 1664361629 1665250111 1.00
fineweb_q04/datafusion:parquet 1683748240 1635880200 1.03
fineweb_q05/datafusion:parquet 1611916932 1699828797 0.95
fineweb_q06/datafusion:parquet 1605639579 1748212665 0.92
fineweb_q07/datafusion:parquet 1745585020 1654085232 1.06
fineweb_q08/datafusion:parquet 1580617109 1925886280 0.82
duckdb / vortex-file-compressed (0.995x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 80591966 85685170 0.94
fineweb_q01/duckdb:vortex-file-compressed 545058055 542207487 1.01
fineweb_q02/duckdb:vortex-file-compressed 467083602 454796844 1.03
fineweb_q03/duckdb:vortex-file-compressed 1455372481 1444070947 1.01
fineweb_q04/duckdb:vortex-file-compressed 1555245203 1519276696 1.02
fineweb_q05/duckdb:vortex-file-compressed 1509241311 1492446746 1.01
fineweb_q06/duckdb:vortex-file-compressed 1710959134 1631348263 1.05
fineweb_q07/duckdb:vortex-file-compressed 1482958939 1463942715 1.01
fineweb_q08/duckdb:vortex-file-compressed 616221412 694976938 0.89
duckdb / vortex-compact (0.999x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 82777984 81909873 1.01
fineweb_q01/duckdb:vortex-compact 515995307 563179911 0.92
fineweb_q02/duckdb:vortex-compact 542166524 563146996 0.96
fineweb_q03/duckdb:vortex-compact 1672569713 1709019211 0.98
fineweb_q04/duckdb:vortex-compact 1726687450 1701799856 1.01
fineweb_q05/duckdb:vortex-compact 1525434277 1498432449 1.02
fineweb_q06/duckdb:vortex-compact 1400845365 1475774479 0.95
fineweb_q07/duckdb:vortex-compact 1321833882 1296799251 1.02
fineweb_q08/duckdb:vortex-compact 521262140 458452786 1.14
duckdb / parquet (0.948x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1035895921 1106775022 0.94
fineweb_q01/duckdb:parquet 1265433572 1384474419 0.91
fineweb_q02/duckdb:parquet 1256041805 1342060595 0.94
fineweb_q03/duckdb:parquet 3409102734 3527031907 0.97
fineweb_q04/duckdb:parquet 1795211574 1821144346 0.99
fineweb_q05/duckdb:parquet 2084197414 2118776518 0.98
fineweb_q06/duckdb:parquet 4068804979 4191601542 0.97
fineweb_q07/duckdb:parquet 2446363699 2671429185 0.92
fineweb_q08/duckdb:parquet 1014342089 1089700134 0.93
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -7.7% -21.1% +16.9% +197.8% ➖ noise
0 datafusion:vortex-file-compressed +8.1% -21.1% +37.0% +156.7% ➖ noise
0 duckdb:vortex-compact +1.1% -21.1% +28.0% +31.0% ➖ noise
0 duckdb:vortex-file-compressed -5.9% -21.1% +19.2% +30.0% ➖ noise
1 datafusion:vortex-compact +10.5% -4.3% +15.5% +74.5% ➖ noise
1 datafusion:vortex-file-compressed +12.0% -4.3% +17.1% +62.5% ➖ noise
1 duckdb:vortex-compact -8.4% -4.3% -4.3% +30.0% ➖ noise
1 duckdb:vortex-file-compressed +0.5% -4.3% +5.0% +30.0% ➖ noise
2 datafusion:vortex-compact -2.7% -5.0% +2.5% +30.0% ➖ noise
2 datafusion:vortex-file-compressed -5.3% -5.0% -0.3% +54.5% ➖ noise
2 duckdb:vortex-compact -3.7% -5.0% +1.4% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +2.7% -5.0% +8.1% +30.4% ➖ noise
3 datafusion:vortex-compact -0.9% -1.7% +0.9% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +7.4% -1.7% +9.2% +30.0% ➖ noise
3 duckdb:vortex-compact -2.1% -1.7% -0.4% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +0.8% -1.7% +2.5% +30.0% ➖ noise
4 datafusion:vortex-compact +5.1% +0.7% +4.3% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -0.1% +0.7% -0.8% +30.0% ➖ noise
4 duckdb:vortex-compact +1.5% +0.7% +0.7% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +2.4% +0.7% +1.6% +30.0% ➖ noise
5 datafusion:vortex-compact +2.7% -3.4% +6.4% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +0.5% -3.4% +4.1% +30.0% ➖ noise
5 duckdb:vortex-compact +1.8% -3.4% +5.4% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +1.1% -3.4% +4.7% +30.0% ➖ noise
6 datafusion:vortex-compact -3.5% -5.6% +2.2% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +1.7% -5.6% +7.7% +30.0% ➖ noise
6 duckdb:vortex-compact -5.1% -5.6% +0.5% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +4.9% -5.6% +11.1% +30.0% ➖ noise
7 datafusion:vortex-compact +0.5% -1.7% +2.2% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -1.5% -1.7% +0.2% +30.0% ➖ noise
7 duckdb:vortex-compact +1.9% -1.7% +3.7% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +1.3% -1.7% +3.0% +30.0% ➖ noise
8 datafusion:vortex-compact -11.3% -12.6% +1.5% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -5.5% -12.6% +8.1% +30.0% ➖ noise
8 duckdb:vortex-compact +13.7% -12.6% +30.1% +30.0% 🚨 regression
8 duckdb:vortex-file-compressed -11.3% -12.6% +1.4% +30.0% ➖ noise

@AdamGS
checked mul
ca6942f 
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 25, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 25, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 25, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.7%
Vortex (geomean): 1.082x ➖
Parquet (geomean): 1.037x ➖
Shifts: Parquet (control) +3.7% · Median polish +5.7%

datafusion / vortex-file-compressed (1.058x ➖, 0↑ 1↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 423682378 389989791 1.09
tpch_q02/datafusion:vortex-file-compressed 115793668 107127362 1.08
tpch_q03/datafusion:vortex-file-compressed 221726453 212127400 1.05
tpch_q04/datafusion:vortex-file-compressed 115504869 113262382 1.02
tpch_q05/datafusion:vortex-file-compressed 381765964 364105008 1.05
tpch_q06/datafusion:vortex-file-compressed 48228412 44630646 1.08
tpch_q07/datafusion:vortex-file-compressed 519551560 494671016 1.05
tpch_q08/datafusion:vortex-file-compressed 370063365 348812428 1.06
tpch_q09/datafusion:vortex-file-compressed 654892004 619858015 1.06
tpch_q10/datafusion:vortex-file-compressed 241236739 230358631 1.05
tpch_q11/datafusion:vortex-file-compressed 83888815 82340560 1.02
tpch_q12/datafusion:vortex-file-compressed 124484383 120549051 1.03
tpch_q13/datafusion:vortex-file-compressed 230438044 211861435 1.09
tpch_q14/datafusion:vortex-file-compressed 59355126 57589046 1.03
tpch_q15/datafusion:vortex-file-compressed 107760305 108111879 1.00
tpch_q16/datafusion:vortex-file-compressed 🚨 90927700 75952347 1.20
tpch_q17/datafusion:vortex-file-compressed 668436150 614040506 1.09
tpch_q18/datafusion:vortex-file-compressed 877759468 816669242 1.07
tpch_q19/datafusion:vortex-file-compressed 96517100 91016681 1.06
tpch_q20/datafusion:vortex-file-compressed 171629032 165167054 1.04
tpch_q21/datafusion:vortex-file-compressed 660940754 636861695 1.04
tpch_q22/datafusion:vortex-file-compressed 66971920 64254133 1.04
datafusion / vortex-compact (1.084x ➖, 0↑ 8↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 442870884 443553087 1.00
tpch_q02/datafusion:vortex-compact 108698755 105753521 1.03
tpch_q03/datafusion:vortex-compact 216391825 213609634 1.01
tpch_q04/datafusion:vortex-compact 129070058 122108001 1.06
tpch_q05/datafusion:vortex-compact 🚨 405818694 367288159 1.10
tpch_q06/datafusion:vortex-compact 69119596 64575729 1.07
tpch_q07/datafusion:vortex-compact 🚨 586440844 509680904 1.15
tpch_q08/datafusion:vortex-compact 🚨 416758895 353800943 1.18
tpch_q09/datafusion:vortex-compact 🚨 742190854 622486131 1.19
tpch_q10/datafusion:vortex-compact 🚨 285802243 246593587 1.16
tpch_q11/datafusion:vortex-compact 86218248 84707975 1.02
tpch_q12/datafusion:vortex-compact 177301388 164713636 1.08
tpch_q13/datafusion:vortex-compact 287918099 262942217 1.09
tpch_q14/datafusion:vortex-compact 🚨 87168873 73905185 1.18
tpch_q15/datafusion:vortex-compact 🚨 188289115 160015983 1.18
tpch_q16/datafusion:vortex-compact 82710100 78659389 1.05
tpch_q17/datafusion:vortex-compact 679996107 622181090 1.09
tpch_q18/datafusion:vortex-compact 853854622 824711432 1.04
tpch_q19/datafusion:vortex-compact 130690603 128006249 1.02
tpch_q20/datafusion:vortex-compact 194505327 190856100 1.02
tpch_q21/datafusion:vortex-compact 🚨 758957572 648881708 1.17
tpch_q22/datafusion:vortex-compact 75230213 74752746 1.01
datafusion / parquet (1.023x ➖, 0↑ 1↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 459964584 473966878 0.97
tpch_q02/datafusion:parquet 172953547 173768792 1.00
tpch_q03/datafusion:parquet 288534098 286270963 1.01
tpch_q04/datafusion:parquet 132914365 130586695 1.02
tpch_q05/datafusion:parquet 440145481 436831892 1.01
tpch_q06/datafusion:parquet 134940492 128021475 1.05
tpch_q07/datafusion:parquet 606401993 609521599 0.99
tpch_q08/datafusion:parquet 469590039 468894441 1.00
tpch_q09/datafusion:parquet 747452967 740403629 1.01
tpch_q10/datafusion:parquet 501240853 502717995 1.00
tpch_q11/datafusion:parquet 121324251 120675809 1.01
tpch_q12/datafusion:parquet 212348681 211515213 1.00
tpch_q13/datafusion:parquet 331347395 332933114 1.00
tpch_q14/datafusion:parquet 169189840 158388876 1.07
tpch_q15/datafusion:parquet 263699633 255145525 1.03
tpch_q16/datafusion:parquet 136552515 129072645 1.06
tpch_q17/datafusion:parquet 🚨 744391348 668218876 1.11
tpch_q18/datafusion:parquet 919515721 856250731 1.07
tpch_q19/datafusion:parquet 292610209 286409092 1.02
tpch_q20/datafusion:parquet 305545144 294704433 1.04
tpch_q21/datafusion:parquet 724970892 697760212 1.04
tpch_q22/datafusion:parquet 213814599 210267835 1.02
datafusion / arrow (1.012x ➖, 1↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 597528676 573626058 1.04
tpch_q02/datafusion:arrow 165901150 160090881 1.04
tpch_q03/datafusion:arrow 467733860 454480482 1.03
tpch_q04/datafusion:arrow 340965104 335972786 1.01
tpch_q05/datafusion:arrow 934570949 902339333 1.04
tpch_q06/datafusion:arrow 286046561 276656793 1.03
tpch_q07/datafusion:arrow 1141631310 1139009543 1.00
tpch_q08/datafusion:arrow 1144036099 1099557724 1.04
tpch_q09/datafusion:arrow 1327642996 1316671935 1.01
tpch_q10/datafusion:arrow 589103665 588292136 1.00
tpch_q11/datafusion:arrow 135770142 135625692 1.00
tpch_q12/datafusion:arrow 🚀 671168512 766683525 0.88
tpch_q13/datafusion:arrow 491213859 482169587 1.02
tpch_q14/datafusion:arrow 323230736 310538258 1.04
tpch_q15/datafusion:arrow 708363245 677318739 1.05
tpch_q16/datafusion:arrow 103379981 102504876 1.01
tpch_q17/datafusion:arrow 1313541059 1279397984 1.03
tpch_q18/datafusion:arrow 1877641217 1821892211 1.03
tpch_q19/datafusion:arrow 481764804 480608548 1.00
tpch_q20/datafusion:arrow 481350548 486041387 0.99
tpch_q21/datafusion:arrow 2970154631 2931172009 1.01
tpch_q22/datafusion:arrow 124004589 127079305 0.98
duckdb / vortex-file-compressed (1.092x ➖, 0↑ 9↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 176777403 171380310 1.03
tpch_q02/duckdb:vortex-file-compressed 53290739 50810118 1.05
tpch_q03/duckdb:vortex-file-compressed 🚨 139188873 124033843 1.12
tpch_q04/duckdb:vortex-file-compressed 🚨 168256882 152553129 1.10
tpch_q05/duckdb:vortex-file-compressed 131600991 126206827 1.04
tpch_q06/duckdb:vortex-file-compressed 🚨 52636857 46472740 1.13
tpch_q07/duckdb:vortex-file-compressed 150968977 144230170 1.05
tpch_q08/duckdb:vortex-file-compressed 🚨 194924515 168458341 1.16
tpch_q09/duckdb:vortex-file-compressed 346976729 320216779 1.08
tpch_q10/duckdb:vortex-file-compressed 🚨 164924662 143348836 1.15
tpch_q11/duckdb:vortex-file-compressed 🚨 35921813 32423609 1.11
tpch_q12/duckdb:vortex-file-compressed 99682604 94257890 1.06
tpch_q13/duckdb:vortex-file-compressed 245379556 224411318 1.09
tpch_q14/duckdb:vortex-file-compressed 69931486 66580489 1.05
tpch_q15/duckdb:vortex-file-compressed 🚨 98545889 86554849 1.14
tpch_q16/duckdb:vortex-file-compressed 85417758 79410767 1.08
tpch_q17/duckdb:vortex-file-compressed 107093901 99629656 1.07
tpch_q18/duckdb:vortex-file-compressed 315055044 288836857 1.09
tpch_q19/duckdb:vortex-file-compressed 85677874 82468351 1.04
tpch_q20/duckdb:vortex-file-compressed 🚨 177817044 156721995 1.13
tpch_q21/duckdb:vortex-file-compressed 🚨 651206198 557383748 1.17
tpch_q22/duckdb:vortex-file-compressed 76831645 70434204 1.09
duckdb / vortex-compact (1.094x ➖, 0↑ 13↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 236401002 228553705 1.03
tpch_q02/duckdb:vortex-compact 59414151 55851179 1.06
tpch_q03/duckdb:vortex-compact 🚨 155120195 137422716 1.13
tpch_q04/duckdb:vortex-compact 🚨 187392082 169461785 1.11
tpch_q05/duckdb:vortex-compact 🚨 158557318 142972696 1.11
tpch_q06/duckdb:vortex-compact 89441827 81905386 1.09
tpch_q07/duckdb:vortex-compact 199538606 196772633 1.01
tpch_q08/duckdb:vortex-compact 🚨 207771142 182702431 1.14
tpch_q09/duckdb:vortex-compact 🚨 385016749 349476070 1.10
tpch_q10/duckdb:vortex-compact 🚨 196261184 175177099 1.12
tpch_q11/duckdb:vortex-compact 🚨 44175627 39605886 1.12
tpch_q12/duckdb:vortex-compact 214113164 200645186 1.07
tpch_q13/duckdb:vortex-compact 🚨 303261626 274878284 1.10
tpch_q14/duckdb:vortex-compact 108644537 98968381 1.10
tpch_q15/duckdb:vortex-compact 🚨 122902307 111135171 1.11
tpch_q16/duckdb:vortex-compact 🚨 93360450 84283105 1.11
tpch_q17/duckdb:vortex-compact 🚨 124141336 112213981 1.11
tpch_q18/duckdb:vortex-compact 311866221 284783057 1.10
tpch_q19/duckdb:vortex-compact 115594814 106654995 1.08
tpch_q20/duckdb:vortex-compact 🚨 222498591 199947812 1.11
tpch_q21/duckdb:vortex-compact 🚨 682688044 609823632 1.12
tpch_q22/duckdb:vortex-compact 88818447 83818176 1.06
duckdb / parquet (1.051x ➖, 0↑ 2↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 265586747 255760801 1.04
tpch_q02/duckdb:parquet 🚨 108003377 97849252 1.10
tpch_q03/duckdb:parquet 221472088 203127260 1.09
tpch_q04/duckdb:parquet 142491448 130462648 1.09
tpch_q05/duckdb:parquet 236533852 218883621 1.08
tpch_q06/duckdb:parquet 70424833 65706669 1.07
tpch_q07/duckdb:parquet 183313266 175839131 1.04
tpch_q08/duckdb:parquet 261000784 255340415 1.02
tpch_q09/duckdb:parquet 515929212 478976902 1.08
tpch_q10/duckdb:parquet 638233824 606027837 1.05
tpch_q11/duckdb:parquet 🚨 59226056 52942922 1.12
tpch_q12/duckdb:parquet 131515285 124172684 1.06
tpch_q13/duckdb:parquet 456081989 451508907 1.01
tpch_q14/duckdb:parquet 180498594 173084984 1.04
tpch_q15/duckdb:parquet 99968755 95140867 1.05
tpch_q16/duckdb:parquet 166254830 161982671 1.03
tpch_q17/duckdb:parquet 181005789 178790392 1.01
tpch_q18/duckdb:parquet 363006482 348323594 1.04
tpch_q19/duckdb:parquet 294192547 285405512 1.03
tpch_q20/duckdb:parquet 237221579 232958057 1.02
tpch_q21/duckdb:parquet 581779057 561838742 1.04
tpch_q22/duckdb:parquet 294819176 291160505 1.01
duckdb / duckdb (1.053x ➖, 0↑ 3↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 119983209 116825484 1.03
tpch_q02/duckdb:duckdb 🚨 50434892 44244569 1.14
tpch_q03/duckdb:duckdb 103202509 96324348 1.07
tpch_q04/duckdb:duckdb 🚨 147085849 132143707 1.11
tpch_q05/duckdb:duckdb 117640890 109780326 1.07
tpch_q06/duckdb:duckdb 39275171 37508381 1.05
tpch_q07/duckdb:duckdb 91031524 85829207 1.06
tpch_q08/duckdb:duckdb 117466439 109271577 1.07
tpch_q09/duckdb:duckdb 291293318 274550148 1.06
tpch_q10/duckdb:duckdb 221807734 202377522 1.10
tpch_q11/duckdb:duckdb 16103402 15538160 1.04
tpch_q12/duckdb:duckdb 88773205 84863674 1.05
tpch_q13/duckdb:duckdb 222201502 218672294 1.02
tpch_q14/duckdb:duckdb 70303767 69967567 1.00
tpch_q15/duckdb:duckdb 76828918 78021242 0.98
tpch_q16/duckdb:duckdb 74373552 73181838 1.02
tpch_q17/duckdb:duckdb 85135119 84764975 1.00
tpch_q18/duckdb:duckdb 214283396 211514390 1.01
tpch_q19/duckdb:duckdb 121820908 116904240 1.04
tpch_q20/duckdb:duckdb 115441114 111584026 1.03
tpch_q21/duckdb:duckdb 🚨 327576895 288342429 1.14
tpch_q22/duckdb:duckdb 71786200 66438943 1.08
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +4.2% +0.4% +3.8% +10.0% ➖ noise
1 datafusion:vortex-compact -0.2% +0.4% -0.5% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +8.6% +0.4% +8.2% +10.0% ➖ noise
1 duckdb:duckdb +2.7% +0.4% +2.3% +10.0% ➖ noise
1 duckdb:vortex-compact +3.4% +0.4% +3.0% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +3.1% +0.4% +2.8% +10.0% ➖ noise
2 datafusion:arrow +3.6% +4.8% -1.1% +10.0% ➖ noise
2 datafusion:vortex-compact +2.8% +4.8% -1.9% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +8.1% +4.8% +3.1% +10.4% ➖ noise
2 duckdb:duckdb +14.0% +4.8% +8.8% +10.0% ➖ noise
2 duckdb:vortex-compact +6.4% +4.8% +1.5% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +4.9% +4.8% +0.1% +11.6% ➖ noise
3 datafusion:arrow +2.9% +4.8% -1.8% +10.0% ➖ noise
3 datafusion:vortex-compact +1.3% +4.8% -3.4% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +4.5% +4.8% -0.3% +10.0% ➖ noise
3 duckdb:duckdb +7.1% +4.8% +2.2% +10.0% ➖ noise
3 duckdb:vortex-compact +12.9% +4.8% +7.7% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +12.2% +4.8% +7.0% +10.0% ➖ noise
4 datafusion:arrow +1.5% +5.4% -3.7% +10.0% ➖ noise
4 datafusion:vortex-compact +5.7% +5.4% +0.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +2.0% +5.4% -3.3% +10.0% ➖ noise
4 duckdb:duckdb +11.3% +5.4% +5.6% +10.0% ➖ noise
4 duckdb:vortex-compact +10.6% +5.4% +4.9% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +10.3% +5.4% +4.6% +10.0% ➖ noise
5 datafusion:arrow +3.6% +4.3% -0.7% +10.0% ➖ noise
5 datafusion:vortex-compact +10.5% +4.3% +5.9% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +4.9% +4.3% +0.5% +10.0% ➖ noise
5 duckdb:duckdb +7.2% +4.3% +2.7% +10.0% ➖ noise
5 duckdb:vortex-compact +10.9% +4.3% +6.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +4.3% +4.3% -0.1% +10.0% ➖ noise
6 datafusion:arrow +3.4% +6.3% -2.7% +10.0% ➖ noise
6 datafusion:vortex-compact +7.0% +6.3% +0.7% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +8.1% +6.3% +1.7% +10.0% ➖ noise
6 duckdb:duckdb +4.7% +6.3% -1.5% +10.2% ➖ noise
6 duckdb:vortex-compact +9.2% +6.3% +2.7% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +13.3% +6.3% +6.6% +11.5% ➖ noise
7 datafusion:arrow +0.2% +1.8% -1.6% +10.0% ➖ noise
7 datafusion:vortex-compact +15.1% +1.8% +13.0% +10.0% 🚨 regression
7 datafusion:vortex-file-compressed +5.0% +1.8% +3.1% +10.0% ➖ noise
7 duckdb:duckdb +6.1% +1.8% +4.1% +10.0% ➖ noise
7 duckdb:vortex-compact +1.4% +1.8% -0.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +4.7% +1.8% +2.8% +10.0% ➖ noise
8 datafusion:arrow +4.0% +1.2% +2.8% +10.0% ➖ noise
8 datafusion:vortex-compact +17.8% +1.2% +16.4% +10.0% 🚨 regression
8 datafusion:vortex-file-compressed +6.1% +1.2% +4.9% +10.0% ➖ noise
8 duckdb:duckdb +7.5% +1.2% +6.2% +10.0% ➖ noise
8 duckdb:vortex-compact +13.7% +1.2% +12.4% +10.0% 🚨 regression
8 duckdb:vortex-file-compressed +15.7% +1.2% +14.4% +10.0% 🚨 regression
9 datafusion:arrow +0.8% +4.3% -3.3% +10.0% ➖ noise
9 datafusion:vortex-compact +19.2% +4.3% +14.3% +10.0% 🚨 regression
9 datafusion:vortex-file-compressed +5.7% +4.3% +1.3% +10.0% ➖ noise
9 duckdb:duckdb +6.1% +4.3% +1.7% +10.0% ➖ noise
9 duckdb:vortex-compact +10.2% +4.3% +5.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +8.4% +4.3% +3.9% +10.0% ➖ noise
10 datafusion:arrow +0.1% +2.5% -2.3% +10.0% ➖ noise
10 datafusion:vortex-compact +15.9% +2.5% +13.1% +10.0% 🚨 regression
10 datafusion:vortex-file-compressed +4.7% +2.5% +2.2% +10.0% ➖ noise
10 duckdb:duckdb +9.6% +2.5% +7.0% +10.0% ➖ noise
10 duckdb:vortex-compact +12.0% +2.5% +9.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +15.1% +2.5% +12.3% +10.0% 🚨 regression
11 datafusion:arrow +0.1% +6.1% -5.6% +10.0% ➖ noise
11 datafusion:vortex-compact +1.8% +6.1% -4.0% +10.9% ➖ noise
11 datafusion:vortex-file-compressed +1.9% +6.1% -3.9% +10.8% ➖ noise
11 duckdb:duckdb +3.6% +6.1% -2.3% +12.0% ➖ noise
11 duckdb:vortex-compact +11.5% +6.1% +5.2% +11.8% ➖ noise
11 duckdb:vortex-file-compressed +10.8% +6.1% +4.5% +10.9% ➖ noise
12 datafusion:arrow -12.5% +3.1% -15.1% +35.7% ➖ noise
12 datafusion:vortex-compact +7.6% +3.1% +4.4% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +3.3% +3.1% +0.1% +10.0% ➖ noise
12 duckdb:duckdb +4.6% +3.1% +1.4% +10.0% ➖ noise
12 duckdb:vortex-compact +6.7% +3.1% +3.5% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +5.8% +3.1% +2.6% +10.0% ➖ noise
13 datafusion:arrow +1.9% +0.3% +1.6% +10.0% ➖ noise
13 datafusion:vortex-compact +9.5% +0.3% +9.2% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +8.8% +0.3% +8.5% +10.0% ➖ noise
13 duckdb:duckdb +1.6% +0.3% +1.3% +10.0% ➖ noise
13 duckdb:vortex-compact +10.3% +0.3% +10.0% +10.0% 🚨 regression
13 duckdb:vortex-file-compressed +9.3% +0.3% +9.1% +10.0% ➖ noise
14 datafusion:arrow +4.1% +5.5% -1.4% +10.0% ➖ noise
14 datafusion:vortex-compact +17.9% +5.5% +11.8% +10.0% 🚨 regression
14 datafusion:vortex-file-compressed +3.1% +5.5% -2.3% +10.0% ➖ noise
14 duckdb:duckdb +0.5% +5.5% -4.8% +10.0% ➖ noise
14 duckdb:vortex-compact +9.8% +5.5% +4.0% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +5.0% +5.5% -0.5% +12.2% ➖ noise
15 datafusion:arrow +4.6% +4.2% +0.4% +10.0% ➖ noise
15 datafusion:vortex-compact +17.7% +4.2% +12.9% +10.0% 🚨 regression
15 datafusion:vortex-file-compressed -0.3% +4.2% -4.4% +10.0% ➖ noise
15 duckdb:duckdb -1.5% +4.2% -5.5% +10.0% ➖ noise
15 duckdb:vortex-compact +10.6% +4.2% +6.1% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +13.9% +4.2% +9.3% +10.0% ➖ noise
16 datafusion:arrow +0.9% +4.2% -3.2% +10.0% ➖ noise
16 datafusion:vortex-compact +5.1% +4.2% +0.9% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +19.7% +4.2% +14.9% +12.1% 🚨 regression
16 duckdb:duckdb +1.6% +4.2% -2.5% +10.0% ➖ noise
16 duckdb:vortex-compact +10.8% +4.2% +6.3% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +7.6% +4.2% +3.2% +10.0% ➖ noise
17 datafusion:arrow +2.7% +6.2% -3.3% +10.0% ➖ noise
17 datafusion:vortex-compact +9.3% +6.2% +2.9% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +8.9% +6.2% +2.5% +10.0% ➖ noise
17 duckdb:duckdb +0.4% +6.2% -5.4% +10.0% ➖ noise
17 duckdb:vortex-compact +10.6% +6.2% +4.2% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +7.5% +6.2% +1.2% +11.5% ➖ noise
18 datafusion:arrow +3.1% +5.8% -2.6% +10.0% ➖ noise
18 datafusion:vortex-compact +3.5% +5.8% -2.1% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +7.5% +5.8% +1.6% +10.0% ➖ noise
18 duckdb:duckdb +1.3% +5.8% -4.2% +10.0% ➖ noise
18 duckdb:vortex-compact +9.5% +5.8% +3.5% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +9.1% +5.8% +3.1% +10.0% ➖ noise
19 datafusion:arrow +0.2% +2.6% -2.3% +10.0% ➖ noise
19 datafusion:vortex-compact +2.1% +2.6% -0.5% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +6.0% +2.6% +3.3% +10.0% ➖ noise
19 duckdb:duckdb +4.2% +2.6% +1.5% +10.0% ➖ noise
19 duckdb:vortex-compact +8.4% +2.6% +5.6% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +3.9% +2.6% +1.2% +10.0% ➖ noise
20 datafusion:arrow -1.0% +2.8% -3.6% +10.0% ➖ noise
20 datafusion:vortex-compact +1.9% +2.8% -0.8% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +3.9% +2.8% +1.1% +10.0% ➖ noise
20 duckdb:duckdb +3.5% +2.8% +0.7% +10.0% ➖ noise
20 duckdb:vortex-compact +11.3% +2.8% +8.3% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +13.5% +2.8% +10.4% +10.0% 🚨 regression
21 datafusion:arrow +1.3% +3.7% -2.3% +10.0% ➖ noise
21 datafusion:vortex-compact +17.0% +3.7% +12.8% +10.0% 🚨 regression
21 datafusion:vortex-file-compressed +3.8% +3.7% +0.1% +10.0% ➖ noise
21 duckdb:duckdb +13.6% +3.7% +9.5% +10.0% ➖ noise
21 duckdb:vortex-compact +11.9% +3.7% +7.9% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +16.8% +3.7% +12.6% +10.0% 🚨 regression
22 datafusion:arrow -2.4% +1.5% -3.8% +10.0% ➖ noise
22 datafusion:vortex-compact +0.6% +1.5% -0.8% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +4.2% +1.5% +2.7% +10.0% ➖ noise
22 duckdb:duckdb +8.0% +1.5% +6.5% +10.0% ➖ noise
22 duckdb:vortex-compact +6.0% +1.5% +4.4% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +9.1% +1.5% +7.5% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 25, 2026

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 25, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.6%
Vortex (geomean): 1.071x ➖
Parquet (geomean): 1.111x ❌
Shifts: Parquet (control) +11.1% · Median polish +7.3%

duckdb / vortex-file-compressed (1.078x ➖, 0↑ 4↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12683443 12477671 1.02
statpopgen_q01/duckdb:vortex-file-compressed 20544759 19983333 1.03
statpopgen_q02/duckdb:vortex-file-compressed 1452633353 1388313969 1.05
statpopgen_q03/duckdb:vortex-file-compressed 3226816628 3216841228 1.00
statpopgen_q04/duckdb:vortex-file-compressed 3284910951 3137340440 1.05
statpopgen_q05/duckdb:vortex-file-compressed 1507541871 1455081647 1.04
statpopgen_q06/duckdb:vortex-file-compressed 2284165342 2148879802 1.06
statpopgen_q07/duckdb:vortex-file-compressed 🚨 264293040 218991559 1.21
statpopgen_q08/duckdb:vortex-file-compressed 🚨 312982741 261885571 1.20
statpopgen_q09/duckdb:vortex-file-compressed 🚨 3288911439 2912682672 1.13
statpopgen_q10/duckdb:vortex-file-compressed 🚨 5260450776 4722051857 1.11
duckdb / vortex-compact (1.064x ➖, 0↑ 2↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 🚨 12735122 11131451 1.14
statpopgen_q01/duckdb:vortex-compact 🚨 185791349 165124067 1.13
statpopgen_q02/duckdb:vortex-compact 1965371897 1795327291 1.09
statpopgen_q03/duckdb:vortex-compact 3774510947 3471208258 1.09
statpopgen_q04/duckdb:vortex-compact 3711208474 3506096022 1.06
statpopgen_q05/duckdb:vortex-compact 1882742964 1812573421 1.04
statpopgen_q06/duckdb:vortex-compact 2796705596 2687218362 1.04
statpopgen_q07/duckdb:vortex-compact 949486708 898804405 1.06
statpopgen_q08/duckdb:vortex-compact 968068743 932524338 1.04
statpopgen_q09/duckdb:vortex-compact 3396001525 3291913461 1.03
statpopgen_q10/duckdb:vortex-compact 5378043409 5387499497 1.00
duckdb / parquet (1.111x ❌, 0↑ 6↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 355229011 326182138 1.09
statpopgen_q01/duckdb:parquet 🚨 458304106 403027510 1.14
statpopgen_q02/duckdb:parquet 🚨 1148701248 989556638 1.16
statpopgen_q03/duckdb:parquet 🚨 1673048983 1496233907 1.12
statpopgen_q04/duckdb:parquet 🚨 1708206995 1483682617 1.15
statpopgen_q05/duckdb:parquet 1099205692 1001916670 1.10
statpopgen_q06/duckdb:parquet 1634213331 1499495753 1.09
statpopgen_q07/duckdb:parquet 🚨 1459818944 1298665468 1.12
statpopgen_q08/duckdb:parquet 1442370339 1323662072 1.09
statpopgen_q09/duckdb:parquet 🚨 1554031735 1355556600 1.15
statpopgen_q10/duckdb:parquet 2767385918 2707041110 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +14.4% +8.9% +5.1% +11.3% ➖ noise
0 duckdb:vortex-file-compressed +1.6% +8.9% -6.7% +14.4% ➖ noise
1 duckdb:vortex-compact +12.5% +13.7% -1.1% +31.3% ➖ noise
1 duckdb:vortex-file-compressed +2.8% +13.7% -9.6% +205.9% ➖ noise
2 duckdb:vortex-compact +9.5% +16.1% -5.7% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +4.6% +16.1% -9.9% +10.0% ✅ faster
3 duckdb:vortex-compact +8.7% +11.8% -2.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.3% +11.8% -10.3% +10.0% ✅ faster
4 duckdb:vortex-compact +5.9% +15.1% -8.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +4.7% +15.1% -9.1% +10.0% ➖ noise
5 duckdb:vortex-compact +3.9% +9.7% -5.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +3.6% +9.7% -5.6% +10.0% ➖ noise
6 duckdb:vortex-compact +4.1% +9.0% -4.5% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +6.3% +9.0% -2.5% +10.0% ➖ noise
7 duckdb:vortex-compact +5.6% +12.4% -6.0% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +20.7% +12.4% +7.4% +10.0% ➖ noise
8 duckdb:vortex-compact +3.8% +9.0% -4.7% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +19.5% +9.0% +9.7% +10.0% ➖ noise
9 duckdb:vortex-compact +3.2% +14.6% -10.0% +10.0% ✅ faster
9 duckdb:vortex-file-compressed +12.9% +14.6% -1.5% +10.0% ➖ noise
10 duckdb:vortex-compact -0.2% +2.2% -2.4% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +11.4% +2.2% +9.0% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 25, 2026

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 25, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.3%
Vortex (geomean): 0.970x ➖
Parquet (geomean): 0.983x ➖
Shifts: Parquet (control) -1.7% · Median polish -2.2%

datafusion / vortex-file-compressed (0.922x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 244603330 251895571 0.97
tpch_q02/datafusion:vortex-file-compressed 396418789 431412098 0.92
tpch_q03/datafusion:vortex-file-compressed 407669115 391817081 1.04
tpch_q04/datafusion:vortex-file-compressed 233998634 249996437 0.94
tpch_q05/datafusion:vortex-file-compressed 382478276 438561897 0.87
tpch_q06/datafusion:vortex-file-compressed 312273894 336059750 0.93
tpch_q07/datafusion:vortex-file-compressed 373250926 403907059 0.92
tpch_q08/datafusion:vortex-file-compressed 530544212 568302119 0.93
tpch_q09/datafusion:vortex-file-compressed 357613221 364776763 0.98
tpch_q10/datafusion:vortex-file-compressed 466855263 496511550 0.94
tpch_q11/datafusion:vortex-file-compressed 261120044 282429713 0.92
tpch_q12/datafusion:vortex-file-compressed 437260656 470920185 0.93
tpch_q13/datafusion:vortex-file-compressed 131605897 141887912 0.93
tpch_q14/datafusion:vortex-file-compressed 238663888 261652478 0.91
tpch_q15/datafusion:vortex-file-compressed 430131951 463447423 0.93
tpch_q16/datafusion:vortex-file-compressed 188635359 187352214 1.01
tpch_q17/datafusion:vortex-file-compressed 324654429 352019201 0.92
tpch_q18/datafusion:vortex-file-compressed 296727200 332620261 0.89
tpch_q19/datafusion:vortex-file-compressed 440266159 448018566 0.98
tpch_q20/datafusion:vortex-file-compressed 416735466 566422918 0.74
tpch_q21/datafusion:vortex-file-compressed 572484438 690088840 0.83
tpch_q22/datafusion:vortex-file-compressed 109007920 122665769 0.89
datafusion / vortex-compact (1.001x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 255512807 245739041 1.04
tpch_q02/datafusion:vortex-compact 400515475 394158432 1.02
tpch_q03/datafusion:vortex-compact 357266375 354109911 1.01
tpch_q04/datafusion:vortex-compact 222774047 211072170 1.06
tpch_q05/datafusion:vortex-compact 364471812 400096595 0.91
tpch_q06/datafusion:vortex-compact 313347734 309742740 1.01
tpch_q07/datafusion:vortex-compact 380811732 387266332 0.98
tpch_q08/datafusion:vortex-compact 473882304 492901498 0.96
tpch_q09/datafusion:vortex-compact 388528489 388564420 1.00
tpch_q10/datafusion:vortex-compact 432732516 415194054 1.04
tpch_q11/datafusion:vortex-compact 239980420 249653484 0.96
tpch_q12/datafusion:vortex-compact 396449412 465082095 0.85
tpch_q13/datafusion:vortex-compact 138196516 122018403 1.13
tpch_q14/datafusion:vortex-compact 255322051 245270199 1.04
tpch_q15/datafusion:vortex-compact 447485628 437351540 1.02
tpch_q16/datafusion:vortex-compact 182286489 173298225 1.05
tpch_q17/datafusion:vortex-compact 342908863 349502303 0.98
tpch_q18/datafusion:vortex-compact 294989542 281442500 1.05
tpch_q19/datafusion:vortex-compact 450633016 475893304 0.95
tpch_q20/datafusion:vortex-compact 431680666 426942786 1.01
tpch_q21/datafusion:vortex-compact 497712095 522909815 0.95
tpch_q22/datafusion:vortex-compact 104260274 100809899 1.03
datafusion / parquet (0.985x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 196363391 219246060 0.90
tpch_q02/datafusion:parquet 416900503 465149218 0.90
tpch_q03/datafusion:parquet 299763531 300311383 1.00
tpch_q04/datafusion:parquet 135487135 138500013 0.98
tpch_q05/datafusion:parquet 448731357 439299897 1.02
tpch_q06/datafusion:parquet 132162023 135362841 0.98
tpch_q07/datafusion:parquet 477306016 454869911 1.05
tpch_q08/datafusion:parquet 553499119 573503315 0.97
tpch_q09/datafusion:parquet 481030645 484718182 0.99
tpch_q10/datafusion:parquet 532621336 508972807 1.05
tpch_q11/datafusion:parquet 336299607 366389347 0.92
tpch_q12/datafusion:parquet 238581120 252894439 0.94
tpch_q13/datafusion:parquet 466351969 424967388 1.10
tpch_q14/datafusion:parquet 167064594 176369472 0.95
tpch_q15/datafusion:parquet 281034779 289340307 0.97
tpch_q16/datafusion:parquet 178661474 167408991 1.07
tpch_q17/datafusion:parquet 383960346 351407598 1.09
tpch_q18/datafusion:parquet 451122354 443982085 1.02
tpch_q19/datafusion:parquet 328459786 334132436 0.98
tpch_q20/datafusion:parquet 306235703 320328618 0.96
tpch_q21/datafusion:parquet 513807250 536893195 0.96
tpch_q22/datafusion:parquet 114407537 123141240 0.93
duckdb / vortex-file-compressed (0.985x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 261532384 248534507 1.05
tpch_q02/duckdb:vortex-file-compressed 870477354 942969156 0.92
tpch_q03/duckdb:vortex-file-compressed 622707583 628823280 0.99
tpch_q04/duckdb:vortex-file-compressed 342320746 360470111 0.95
tpch_q05/duckdb:vortex-file-compressed 841203451 899292377 0.94
tpch_q06/duckdb:vortex-file-compressed 383768583 389746583 0.98
tpch_q07/duckdb:vortex-file-compressed 784866099 780185919 1.01
tpch_q08/duckdb:vortex-file-compressed 963804525 931441442 1.03
tpch_q09/duckdb:vortex-file-compressed 812304963 851736028 0.95
tpch_q10/duckdb:vortex-file-compressed 727348061 761825023 0.95
tpch_q11/duckdb:vortex-file-compressed 505744840 479663078 1.05
tpch_q12/duckdb:vortex-file-compressed 449750594 448079223 1.00
tpch_q13/duckdb:vortex-file-compressed 457285330 460196058 0.99
tpch_q14/duckdb:vortex-file-compressed 473137496 410215529 1.15
tpch_q15/duckdb:vortex-file-compressed 276884820 272634344 1.02
tpch_q16/duckdb:vortex-file-compressed 396827828 375137229 1.06
tpch_q17/duckdb:vortex-file-compressed 642998064 691865192 0.93
tpch_q18/duckdb:vortex-file-compressed 522073241 559679666 0.93
tpch_q19/duckdb:vortex-file-compressed 452005279 467820227 0.97
tpch_q20/duckdb:vortex-file-compressed 775103779 805640503 0.96
tpch_q21/duckdb:vortex-file-compressed 992835605 1069312787 0.93
tpch_q22/duckdb:vortex-file-compressed 346062325 373076343 0.93
duckdb / vortex-compact (0.973x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 279720825 266704988 1.05
tpch_q02/duckdb:vortex-compact 870267867 903721381 0.96
tpch_q03/duckdb:vortex-compact 567509234 592143924 0.96
tpch_q04/duckdb:vortex-compact 331993362 336571190 0.99
tpch_q05/duckdb:vortex-compact 818018795 844255820 0.97
tpch_q06/duckdb:vortex-compact 376664233 419285485 0.90
tpch_q07/duckdb:vortex-compact 753868732 767241699 0.98
tpch_q08/duckdb:vortex-compact 866146916 964531859 0.90
tpch_q09/duckdb:vortex-compact 833157364 822550761 1.01
tpch_q10/duckdb:vortex-compact 661724452 680913973 0.97
tpch_q11/duckdb:vortex-compact 463678641 464867415 1.00
tpch_q12/duckdb:vortex-compact 449201304 446957435 1.01
tpch_q13/duckdb:vortex-compact 440579322 437829235 1.01
tpch_q14/duckdb:vortex-compact 421262116 436102315 0.97
tpch_q15/duckdb:vortex-compact 272738649 290113010 0.94
tpch_q16/duckdb:vortex-compact 345284938 350665011 0.98
tpch_q17/duckdb:vortex-compact 540125575 603137676 0.90
tpch_q18/duckdb:vortex-compact 455610365 461354651 0.99
tpch_q19/duckdb:vortex-compact 417646938 440181468 0.95
tpch_q20/duckdb:vortex-compact 712623782 751657792 0.95
tpch_q21/duckdb:vortex-compact 1013342726 1034500470 0.98
tpch_q22/duckdb:vortex-compact 347110182 320402916 1.08
duckdb / parquet (0.982x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 432457342 422925416 1.02
tpch_q02/duckdb:parquet 1138293179 1205018211 0.94
tpch_q03/duckdb:parquet 973989644 1014905149 0.96
tpch_q04/duckdb:parquet 629842610 628062219 1.00
tpch_q05/duckdb:parquet 1452252910 1381055544 1.05
tpch_q06/duckdb:parquet 374976121 393236452 0.95
tpch_q07/duckdb:parquet 1241032660 1174565614 1.06
tpch_q08/duckdb:parquet 1625991358 1593693707 1.02
tpch_q09/duckdb:parquet 1327080786 1369000165 0.97
tpch_q10/duckdb:parquet 1194874598 1231392836 0.97
tpch_q11/duckdb:parquet 858996574 842751351 1.02
tpch_q12/duckdb:parquet 652568664 637878425 1.02
tpch_q13/duckdb:parquet 970298009 908247215 1.07
tpch_q14/duckdb:parquet 612865536 668708545 0.92
tpch_q15/duckdb:parquet 459094908 486956688 0.94
tpch_q16/duckdb:parquet 580982151 667970481 0.87
tpch_q17/duckdb:parquet 726873084 694699534 1.05
tpch_q18/duckdb:parquet 809463539 853818574 0.95
tpch_q19/duckdb:parquet 709356876 768155277 0.92
tpch_q20/duckdb:parquet 1018750076 1134908845 0.90
tpch_q21/duckdb:parquet 1091542074 1122947830 0.97
tpch_q22/duckdb:parquet 529735564 502830402 1.05
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +4.0% -4.3% +8.7% +69.7% ➖ noise
1 datafusion:vortex-file-compressed -2.9% -4.3% +1.5% +63.4% ➖ noise
1 duckdb:vortex-compact +4.9% -4.3% +9.6% +38.6% ➖ noise
1 duckdb:vortex-file-compressed +5.2% -4.3% +10.0% +30.0% ➖ noise
2 datafusion:vortex-compact +1.6% -8.0% +10.4% +30.0% ➖ noise
2 datafusion:vortex-file-compressed -8.1% -8.0% -0.1% +30.0% ➖ noise
2 duckdb:vortex-compact -3.7% -8.0% +4.7% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -7.7% -8.0% +0.3% +30.0% ➖ noise
3 datafusion:vortex-compact +0.9% -2.1% +3.1% +41.0% ➖ noise
3 datafusion:vortex-file-compressed +4.0% -2.1% +6.3% +50.3% ➖ noise
3 duckdb:vortex-compact -4.2% -2.1% -2.1% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -1.0% -2.1% +1.2% +30.0% ➖ noise
4 datafusion:vortex-compact +5.5% -1.0% +6.6% +36.5% ➖ noise
4 datafusion:vortex-file-compressed -6.4% -1.0% -5.5% +30.0% ➖ noise
4 duckdb:vortex-compact -1.4% -1.0% -0.4% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -5.0% -1.0% -4.1% +30.0% ➖ noise
5 datafusion:vortex-compact -8.9% +3.6% -12.1% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -12.8% +3.6% -15.9% +30.0% ➖ noise
5 duckdb:vortex-compact -3.1% +3.6% -6.5% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -6.5% +3.6% -9.7% +30.0% ➖ noise
6 datafusion:vortex-compact +1.2% -3.5% +4.8% +34.1% ➖ noise
6 datafusion:vortex-file-compressed -7.1% -3.5% -3.7% +30.0% ➖ noise
6 duckdb:vortex-compact -10.2% -3.5% -6.9% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -1.5% -3.5% +2.0% +30.0% ➖ noise
7 datafusion:vortex-compact -1.7% +5.3% -6.6% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -7.6% +5.3% -12.2% +30.0% ➖ noise
7 duckdb:vortex-compact -1.7% +5.3% -6.7% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +0.6% +5.3% -4.5% +30.0% ➖ noise
8 datafusion:vortex-compact -3.9% -0.8% -3.1% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -6.6% -0.8% -5.9% +30.0% ➖ noise
8 duckdb:vortex-compact -10.2% -0.8% -9.5% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +3.5% -0.8% +4.3% +30.0% ➖ noise
9 datafusion:vortex-compact -0.0% -1.9% +1.9% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -2.0% -1.9% -0.0% +30.0% ➖ noise
9 duckdb:vortex-compact +1.3% -1.9% +3.3% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -4.6% -1.9% -2.8% +30.0% ➖ noise
10 datafusion:vortex-compact +4.2% +0.8% +3.4% +30.0% ➖ noise
10 datafusion:vortex-file-compressed -6.0% +0.8% -6.7% +30.0% ➖ noise
10 duckdb:vortex-compact -2.8% +0.8% -3.6% +30.0% ➖ noise
10 duckdb:vortex-file-compressed -4.5% +0.8% -5.3% +30.0% ➖ noise
11 datafusion:vortex-compact -3.9% -3.3% -0.6% +30.0% ➖ noise
11 datafusion:vortex-file-compressed -7.5% -3.3% -4.4% +30.0% ➖ noise
11 duckdb:vortex-compact -0.3% -3.3% +3.1% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +5.4% -3.3% +9.0% +30.0% ➖ noise
12 datafusion:vortex-compact -14.8% -1.8% -13.2% +30.0% ➖ noise
12 datafusion:vortex-file-compressed -7.1% -1.8% -5.5% +30.0% ➖ noise
12 duckdb:vortex-compact +0.5% -1.8% +2.3% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +0.4% -1.8% +2.2% +30.0% ➖ noise
13 datafusion:vortex-compact +13.3% +8.3% +4.6% +50.6% ➖ noise
13 datafusion:vortex-file-compressed -7.2% +8.3% -14.3% +40.2% ➖ noise
13 duckdb:vortex-compact +0.6% +8.3% -7.1% +30.0% ➖ noise
13 duckdb:vortex-file-compressed -0.6% +8.3% -8.2% +30.0% ➖ noise
14 datafusion:vortex-compact +4.1% -6.8% +11.7% +30.0% ➖ noise
14 datafusion:vortex-file-compressed -8.8% -6.8% -2.1% +30.0% ➖ noise
14 duckdb:vortex-compact -3.4% -6.8% +3.7% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +15.3% -6.8% +23.8% +30.0% ➖ noise
15 datafusion:vortex-compact +2.3% -4.3% +6.9% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -7.2% -4.3% -3.0% +30.0% ➖ noise
15 duckdb:vortex-compact -6.0% -4.3% -1.8% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +1.6% -4.3% +6.1% +30.0% ➖ noise
16 datafusion:vortex-compact +5.2% -3.7% +9.2% +30.0% ➖ noise
16 datafusion:vortex-file-compressed +0.7% -3.7% +4.5% +30.0% ➖ noise
16 duckdb:vortex-compact -1.5% -3.7% +2.2% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +5.8% -3.7% +9.8% +30.0% ➖ noise
17 datafusion:vortex-compact -1.9% +6.9% -8.2% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -7.8% +6.9% -13.7% +30.0% ➖ noise
17 duckdb:vortex-compact -10.4% +6.9% -16.2% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -7.1% +6.9% -13.1% +30.0% ➖ noise
18 datafusion:vortex-compact +4.8% -1.9% +6.8% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -10.8% -1.9% -9.1% +30.0% ➖ noise
18 duckdb:vortex-compact -1.2% -1.9% +0.6% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -6.7% -1.9% -5.0% +30.0% ➖ noise
19 datafusion:vortex-compact -5.3% -4.7% -0.6% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -1.7% -4.7% +3.1% +30.0% ➖ noise
19 duckdb:vortex-compact -5.1% -4.7% -0.4% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -3.4% -4.7% +1.4% +30.0% ➖ noise
20 datafusion:vortex-compact +1.1% -7.4% +9.1% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -26.4% -7.4% -20.6% +37.6% ➖ noise
20 duckdb:vortex-compact -5.2% -7.4% +2.3% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -3.8% -7.4% +3.9% +30.0% ➖ noise
21 datafusion:vortex-compact -4.8% -3.6% -1.3% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -17.0% -3.6% -14.0% +30.0% ➖ noise
21 duckdb:vortex-compact -2.0% -3.6% +1.6% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -7.2% -3.6% -3.7% +30.0% ➖ noise
22 datafusion:vortex-compact +3.4% -1.1% +4.5% +30.0% ➖ noise
22 datafusion:vortex-file-compressed -11.1% -1.1% -10.2% +55.2% ➖ noise
22 duckdb:vortex-compact +8.3% -1.1% +9.5% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -7.2% -1.1% -6.2% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 25, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Vortex (geomean): 1.001x ➖
Parquet (geomean): 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.5%

datafusion / vortex-file-compressed (1.007x ➖, 1↑ 2↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1827598 1681220 1.09
clickbench_q01/datafusion:vortex-file-compressed 19210285 20056352 0.96
clickbench_q02/datafusion:vortex-file-compressed 37585533 38138337 0.99
clickbench_q03/datafusion:vortex-file-compressed 🚨 47449812 42555106 1.12
clickbench_q04/datafusion:vortex-file-compressed 282386983 284597522 0.99
clickbench_q05/datafusion:vortex-file-compressed 302842048 296057368 1.02
clickbench_q06/datafusion:vortex-file-compressed 1626709 1602831 1.01
clickbench_q07/datafusion:vortex-file-compressed 23440627 22882636 1.02
clickbench_q08/datafusion:vortex-file-compressed 349774263 355605323 0.98
clickbench_q09/datafusion:vortex-file-compressed 550351223 552109656 1.00
clickbench_q10/datafusion:vortex-file-compressed 75427609 74322620 1.01
clickbench_q11/datafusion:vortex-file-compressed 86507009 86725298 1.00
clickbench_q12/datafusion:vortex-file-compressed 266057661 273447045 0.97
clickbench_q13/datafusion:vortex-file-compressed 416447555 411642145 1.01
clickbench_q14/datafusion:vortex-file-compressed 251697587 258249109 0.97
clickbench_q15/datafusion:vortex-file-compressed 328061646 324772090 1.01
clickbench_q16/datafusion:vortex-file-compressed 649446370 638697954 1.02
clickbench_q17/datafusion:vortex-file-compressed 633465756 631385747 1.00
clickbench_q18/datafusion:vortex-file-compressed 1284810298 1275226022 1.01
clickbench_q19/datafusion:vortex-file-compressed 🚨 33354834 28687170 1.16
clickbench_q20/datafusion:vortex-file-compressed 340895431 335575295 1.02
clickbench_q21/datafusion:vortex-file-compressed 363794371 363803142 1.00
clickbench_q22/datafusion:vortex-file-compressed 448725227 448549573 1.00
clickbench_q23/datafusion:vortex-file-compressed 684403580 656612469 1.04
clickbench_q24/datafusion:vortex-file-compressed 48219393 45659193 1.06
clickbench_q25/datafusion:vortex-file-compressed 74570951 72180576 1.03
clickbench_q26/datafusion:vortex-file-compressed 46557597 43220356 1.08
clickbench_q27/datafusion:vortex-file-compressed 732574619 718502750 1.02
clickbench_q28/datafusion:vortex-file-compressed 6733206077 6791937805 0.99
clickbench_q29/datafusion:vortex-file-compressed 231747829 240384464 0.96
clickbench_q30/datafusion:vortex-file-compressed 220717753 221755437 1.00
clickbench_q31/datafusion:vortex-file-compressed 255870028 257332101 0.99
clickbench_q32/datafusion:vortex-file-compressed 1109047196 1094309888 1.01
clickbench_q33/datafusion:vortex-file-compressed 1296106668 1282962237 1.01
clickbench_q34/datafusion:vortex-file-compressed 1283823224 1278575698 1.00
clickbench_q35/datafusion:vortex-file-compressed 449564448 459393395 0.98
clickbench_q36/datafusion:vortex-file-compressed 72097567 71419239 1.01
clickbench_q37/datafusion:vortex-file-compressed 34709373 34720070 1.00
clickbench_q38/datafusion:vortex-file-compressed 19180248 18952547 1.01
clickbench_q39/datafusion:vortex-file-compressed 133871376 132008390 1.01
clickbench_q40/datafusion:vortex-file-compressed 16252772 17843976 0.91
clickbench_q41/datafusion:vortex-file-compressed 🚀 15000738 16796628 0.89
clickbench_q42/datafusion:vortex-file-compressed 17933103 18566203 0.97
datafusion / parquet (1.021x ➖, 0↑ 3↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1550681 1554075 1.00
clickbench_q01/datafusion:parquet 🚨 21078246 18955548 1.11
clickbench_q02/datafusion:parquet 46972692 48750918 0.96
clickbench_q03/datafusion:parquet 39039365 37931428 1.03
clickbench_q04/datafusion:parquet 298895627 296829332 1.01
clickbench_q05/datafusion:parquet 356991339 344185352 1.04
clickbench_q06/datafusion:parquet 1577243 1559977 1.01
clickbench_q07/datafusion:parquet 23399132 21967482 1.07
clickbench_q08/datafusion:parquet 369300460 368683598 1.00
clickbench_q09/datafusion:parquet 620260241 615197070 1.01
clickbench_q10/datafusion:parquet 113787264 111426655 1.02
clickbench_q11/datafusion:parquet 142908614 133207606 1.07
clickbench_q12/datafusion:parquet 362004017 348204478 1.04
clickbench_q13/datafusion:parquet 🚨 529799114 479459211 1.10
clickbench_q14/datafusion:parquet 353091914 344924591 1.02
clickbench_q15/datafusion:parquet 347949422 335617442 1.04
clickbench_q16/datafusion:parquet 703866302 654557105 1.08
clickbench_q17/datafusion:parquet 645188754 644460903 1.00
clickbench_q18/datafusion:parquet 1393940542 1294825065 1.08
clickbench_q19/datafusion:parquet 🚨 33132677 29927075 1.11
clickbench_q20/datafusion:parquet 612223016 599791310 1.02
clickbench_q21/datafusion:parquet 686865395 664288305 1.03
clickbench_q22/datafusion:parquet 1001755598 979129523 1.02
clickbench_q23/datafusion:parquet 3764004334 3680692066 1.02
clickbench_q24/datafusion:parquet 85332778 81634961 1.05
clickbench_q25/datafusion:parquet 138565705 138091230 1.00
clickbench_q26/datafusion:parquet 85606482 85143654 1.01
clickbench_q27/datafusion:parquet 1061105132 1041451051 1.02
clickbench_q28/datafusion:parquet 6721217528 6714023782 1.00
clickbench_q29/datafusion:parquet 240255891 242275692 0.99
clickbench_q30/datafusion:parquet 327235990 328021803 1.00
clickbench_q31/datafusion:parquet 354909272 366786094 0.97
clickbench_q32/datafusion:parquet 1191225256 1214650599 0.98
clickbench_q33/datafusion:parquet 1468278617 1461116107 1.00
clickbench_q34/datafusion:parquet 1496834785 1479924563 1.01
clickbench_q35/datafusion:parquet 455689814 455091744 1.00
clickbench_q36/datafusion:parquet 139844757 139598912 1.00
clickbench_q37/datafusion:parquet 57546768 59955407 0.96
clickbench_q38/datafusion:parquet 83167395 82802601 1.00
clickbench_q39/datafusion:parquet 259029355 259579579 1.00
clickbench_q40/datafusion:parquet 31970085 30077899 1.06
clickbench_q41/datafusion:parquet 26560519 27227906 0.98
clickbench_q42/datafusion:parquet 29783963 29321695 1.02
duckdb / vortex-file-compressed (0.995x ➖, 1↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 5920091 5808394 1.02
clickbench_q01/duckdb:vortex-file-compressed 13733049 13960036 0.98
clickbench_q02/duckdb:vortex-file-compressed 25874714 26278565 0.98
clickbench_q03/duckdb:vortex-file-compressed 29394795 30745364 0.96
clickbench_q04/duckdb:vortex-file-compressed 184334587 185715238 0.99
clickbench_q05/duckdb:vortex-file-compressed 173851496 171601678 1.01
clickbench_q06/duckdb:vortex-file-compressed 18895915 19076470 0.99
clickbench_q07/duckdb:vortex-file-compressed 14880315 16037800 0.93
clickbench_q08/duckdb:vortex-file-compressed 254022680 260777303 0.97
clickbench_q09/duckdb:vortex-file-compressed 335864193 345625705 0.97
clickbench_q10/duckdb:vortex-file-compressed 67756311 68282813 0.99
clickbench_q11/duckdb:vortex-file-compressed 77558243 77956463 0.99
clickbench_q12/duckdb:vortex-file-compressed 192798862 193315337 1.00
clickbench_q13/duckdb:vortex-file-compressed 392313198 402166479 0.98
clickbench_q14/duckdb:vortex-file-compressed 231028446 239855660 0.96
clickbench_q15/duckdb:vortex-file-compressed 239391105 237612575 1.01
clickbench_q16/duckdb:vortex-file-compressed 581315374 580911737 1.00
clickbench_q17/duckdb:vortex-file-compressed 480494948 481418708 1.00
clickbench_q18/duckdb:vortex-file-compressed 989879683 962247669 1.03
clickbench_q19/duckdb:vortex-file-compressed 21343917 22437490 0.95
clickbench_q20/duckdb:vortex-file-compressed 327463099 346988104 0.94
clickbench_q21/duckdb:vortex-file-compressed 369781422 365060357 1.01
clickbench_q22/duckdb:vortex-file-compressed 592153972 556270032 1.06
clickbench_q23/duckdb:vortex-file-compressed 🚀 1465473430 1713153784 0.86
clickbench_q24/duckdb:vortex-file-compressed 47883284 49409775 0.97
clickbench_q25/duckdb:vortex-file-compressed 81178235 85159866 0.95
clickbench_q26/duckdb:vortex-file-compressed 43200886 46166568 0.94
clickbench_q27/duckdb:vortex-file-compressed 482273332 477265045 1.01
clickbench_q28/duckdb:vortex-file-compressed 2966550692 2973053779 1.00
clickbench_q29/duckdb:vortex-file-compressed 27861547 28849581 0.97
clickbench_q30/duckdb:vortex-file-compressed 192040266 192283052 1.00
clickbench_q31/duckdb:vortex-file-compressed 282973370 275446330 1.03
clickbench_q32/duckdb:vortex-file-compressed 1298726218 1188263512 1.09
clickbench_q33/duckdb:vortex-file-compressed 1255183582 1214905099 1.03
clickbench_q34/duckdb:vortex-file-compressed 1246832182 1305766342 0.95
clickbench_q35/duckdb:vortex-file-compressed 379787857 370780281 1.02
clickbench_q36/duckdb:vortex-file-compressed 28822164 27576998 1.05
clickbench_q37/duckdb:vortex-file-compressed 22010934 20420360 1.08
clickbench_q38/duckdb:vortex-file-compressed 22256637 21961037 1.01
clickbench_q39/duckdb:vortex-file-compressed 40471856 41202534 0.98
clickbench_q40/duckdb:vortex-file-compressed 22632577 21773077 1.04
clickbench_q41/duckdb:vortex-file-compressed 21104268 20062886 1.05
clickbench_q42/duckdb:vortex-file-compressed 22218236 21350905 1.04
duckdb / parquet (0.974x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 24822565 26699922 0.93
clickbench_q01/duckdb:parquet 26506945 27867163 0.95
clickbench_q02/duckdb:parquet 48207361 48190304 1.00
clickbench_q03/duckdb:parquet 38253059 38652035 0.99
clickbench_q04/duckdb:parquet 203883292 207732147 0.98
clickbench_q05/duckdb:parquet 261804272 261011745 1.00
clickbench_q06/duckdb:parquet 46058834 45843254 1.00
clickbench_q07/duckdb:parquet 28824888 29971079 0.96
clickbench_q08/duckdb:parquet 263049722 273984467 0.96
clickbench_q09/duckdb:parquet 397294083 401108046 0.99
clickbench_q10/duckdb:parquet 80947188 89154532 0.91
clickbench_q11/duckdb:parquet 97349143 107875005 0.90
clickbench_q12/duckdb:parquet 280826131 297414495 0.94
clickbench_q13/duckdb:parquet 478480853 509174417 0.94
clickbench_q14/duckdb:parquet 328390386 326420438 1.01
clickbench_q15/duckdb:parquet 254762826 274885364 0.93
clickbench_q16/duckdb:parquet 644899172 685661902 0.94
clickbench_q17/duckdb:parquet 533699443 563468748 0.95
clickbench_q18/duckdb:parquet 1082283255 1115438909 0.97
clickbench_q19/duckdb:parquet 26203365 26554804 0.99
clickbench_q20/duckdb:parquet 423914772 435790121 0.97
clickbench_q21/duckdb:parquet 544570807 564621786 0.96
clickbench_q22/duckdb:parquet 925851236 947255685 0.98
clickbench_q23/duckdb:parquet 309850288 313953311 0.99
clickbench_q24/duckdb:parquet 69372191 68138545 1.02
clickbench_q25/duckdb:parquet 157584509 156773176 1.01
clickbench_q26/duckdb:parquet 50881320 47677999 1.07
clickbench_q27/duckdb:parquet 640939277 643953872 1.00
clickbench_q28/duckdb:parquet 4831851395 4851141758 1.00
clickbench_q29/duckdb:parquet 40242494 41172903 0.98
clickbench_q30/duckdb:parquet 301434426 308616957 0.98
clickbench_q31/duckdb:parquet 359201959 367497666 0.98
clickbench_q32/duckdb:parquet 1168681909 1179880429 0.99
clickbench_q33/duckdb:parquet 1281666003 1328853610 0.96
clickbench_q34/duckdb:parquet 1324942573 1310511703 1.01
clickbench_q35/duckdb:parquet 362914675 363073082 1.00
clickbench_q36/duckdb:parquet 46746531 48335818 0.97
clickbench_q37/duckdb:parquet 31429116 32123189 0.98
clickbench_q38/duckdb:parquet 33364138 34032757 0.98
clickbench_q39/duckdb:parquet 82428907 86449559 0.95
clickbench_q40/duckdb:parquet 17825806 18864870 0.94
clickbench_q41/duckdb:parquet 17275003 17571672 0.98
clickbench_q42/duckdb:parquet 21341463 21989415 0.97
duckdb / duckdb (0.977x ➖, 3↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17474399 18273209 0.96
clickbench_q01/duckdb:duckdb 32023204 33411745 0.96
clickbench_q02/duckdb:duckdb 45676570 46177458 0.99
clickbench_q03/duckdb:duckdb 48086355 47223493 1.02
clickbench_q04/duckdb:duckdb 184644614 185894079 0.99
clickbench_q05/duckdb:duckdb 266648893 264892361 1.01
clickbench_q06/duckdb:duckdb 🚀 28287141 35343647 0.80
clickbench_q07/duckdb:duckdb 35292245 36045735 0.98
clickbench_q08/duckdb:duckdb 248617813 246060277 1.01
clickbench_q09/duckdb:duckdb 367730481 366084529 1.00
clickbench_q10/duckdb:duckdb 97644533 97280449 1.00
clickbench_q11/duckdb:duckdb 108036367 106548933 1.01
clickbench_q12/duckdb:duckdb 237405787 239195603 0.99
clickbench_q13/duckdb:duckdb 470112461 483187955 0.97
clickbench_q14/duckdb:duckdb 276802003 274157355 1.01
clickbench_q15/duckdb:duckdb 218984207 217490565 1.01
clickbench_q16/duckdb:duckdb 662563533 663437456 1.00
clickbench_q17/duckdb:duckdb 550658674 569583718 0.97
clickbench_q18/duckdb:duckdb 1233673272 1289304553 0.96
clickbench_q19/duckdb:duckdb 34611606 35060977 0.99
clickbench_q20/duckdb:duckdb 🚀 912518052 1039101104 0.88
clickbench_q21/duckdb:duckdb 980053857 1009271667 0.97
clickbench_q22/duckdb:duckdb 1144041208 1112545685 1.03
clickbench_q23/duckdb:duckdb 260923497 254220168 1.03
clickbench_q24/duckdb:duckdb 61163535 61875016 0.99
clickbench_q25/duckdb:duckdb 140580250 142473413 0.99
clickbench_q26/duckdb:duckdb 61191307 61274290 1.00
clickbench_q27/duckdb:duckdb 🚀 998268379 1128399809 0.88
clickbench_q28/duckdb:duckdb 4644214351 4717644185 0.98
clickbench_q29/duckdb:duckdb 47971257 48744079 0.98
clickbench_q30/duckdb:duckdb 261541984 265236711 0.99
clickbench_q31/duckdb:duckdb 424802708 427451675 0.99
clickbench_q32/duckdb:duckdb 1500858258 1563659594 0.96
clickbench_q33/duckdb:duckdb 1912153870 2044256980 0.94
clickbench_q34/duckdb:duckdb 2131892136 2158648253 0.99
clickbench_q35/duckdb:duckdb 278436923 282016828 0.99
clickbench_q36/duckdb:duckdb 40877493 39113848 1.05
clickbench_q37/duckdb:duckdb 30846440 31658786 0.97
clickbench_q38/duckdb:duckdb 30281576 31352937 0.97
clickbench_q39/duckdb:duckdb 66739664 68061047 0.98
clickbench_q40/duckdb:duckdb 31378103 32379048 0.97
clickbench_q41/duckdb:duckdb 30214393 31887791 0.95
clickbench_q42/duckdb:duckdb 31447170 31950564 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +8.7% -3.7% +12.9% +775.1% ➖ noise
0 duckdb:duckdb -4.4% -3.7% -0.7% +291.0% ➖ noise
0 duckdb:vortex-file-compressed +1.9% -3.7% +5.8% +484.6% ➖ noise
1 datafusion:vortex-file-compressed -4.2% +2.8% -6.9% +24.7% ➖ noise
1 duckdb:duckdb -4.2% +2.8% -6.8% +64.5% ➖ noise
1 duckdb:vortex-file-compressed -1.6% +2.8% -4.3% +29.4% ➖ noise
2 datafusion:vortex-file-compressed -1.4% -1.8% +0.4% +13.0% ➖ noise
2 duckdb:duckdb -1.1% -1.8% +0.8% +22.4% ➖ noise
2 duckdb:vortex-file-compressed -1.5% -1.8% +0.3% +13.1% ➖ noise
3 datafusion:vortex-file-compressed +11.5% +0.9% +10.5% +137.6% ➖ noise
3 duckdb:duckdb +1.8% +0.9% +0.9% +48.0% ➖ noise
3 duckdb:vortex-file-compressed -4.4% +0.9% -5.3% +30.9% ➖ noise
4 datafusion:vortex-file-compressed -0.8% -0.6% -0.2% +10.0% ➖ noise
4 duckdb:duckdb -0.7% -0.6% -0.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.7% -0.6% -0.2% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +2.3% +2.0% +0.3% +10.0% ➖ noise
5 duckdb:duckdb +0.7% +2.0% -1.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.3% +2.0% -0.7% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +1.5% +0.8% +0.7% +39.1% ➖ noise
6 duckdb:duckdb -20.0% +0.8% -20.6% +28.7% ➖ noise
6 duckdb:vortex-file-compressed -0.9% +0.8% -1.7% +22.3% ➖ noise
7 datafusion:vortex-file-compressed +2.4% +1.2% +1.2% +13.4% ➖ noise
7 duckdb:duckdb -2.1% +1.2% -3.3% +11.5% ➖ noise
7 duckdb:vortex-file-compressed -7.2% +1.2% -8.3% +10.6% ➖ noise
8 datafusion:vortex-file-compressed -1.6% -1.9% +0.3% +10.0% ➖ noise
8 duckdb:duckdb +1.0% -1.9% +3.0% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -2.6% -1.9% -0.7% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -0.3% -0.1% -0.3% +10.0% ➖ noise
9 duckdb:duckdb +0.4% -0.1% +0.5% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -2.8% -0.1% -2.8% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +1.5% -3.7% +5.4% +10.0% ➖ noise
10 duckdb:duckdb +0.4% -3.7% +4.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.8% -3.7% +3.1% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -0.3% -1.6% +1.4% +10.0% ➖ noise
11 duckdb:duckdb +1.4% -1.6% +3.1% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -0.5% -1.6% +1.1% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -2.7% -0.9% -1.8% +10.0% ➖ noise
12 duckdb:duckdb -0.7% -0.9% +0.2% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -0.3% -0.9% +0.7% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +1.2% +1.9% -0.7% +10.0% ➖ noise
13 duckdb:duckdb -2.7% +1.9% -4.5% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -2.5% +1.9% -4.3% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -2.5% +1.5% -4.0% +10.0% ➖ noise
14 duckdb:duckdb +1.0% +1.5% -0.5% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -3.7% +1.5% -5.1% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +1.0% -2.0% +3.1% +10.0% ➖ noise
15 duckdb:duckdb +0.7% -2.0% +2.7% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +0.7% -2.0% +2.8% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +1.7% +0.6% +1.1% +10.0% ➖ noise
16 duckdb:duckdb -0.1% +0.6% -0.7% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +0.1% +0.6% -0.5% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +0.3% -2.6% +3.0% +10.0% ➖ noise
17 duckdb:duckdb -3.3% -2.6% -0.7% +11.6% ➖ noise
17 duckdb:vortex-file-compressed -0.2% -2.6% +2.5% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +0.8% +2.2% -1.4% +10.0% ➖ noise
18 duckdb:duckdb -4.3% +2.2% -6.4% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +2.9% +2.2% +0.7% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +16.3% +4.5% +11.2% +20.3% ➖ noise
19 duckdb:duckdb -1.3% +4.5% -5.6% +11.8% ➖ noise
19 duckdb:vortex-file-compressed -4.9% +4.5% -9.0% +12.2% ➖ noise
20 datafusion:vortex-file-compressed +1.6% -0.4% +1.9% +209.0% ➖ noise
20 duckdb:duckdb -12.2% -0.4% -11.9% +28.1% ➖ noise
20 duckdb:vortex-file-compressed -5.6% -0.4% -5.3% +48.7% ➖ noise
21 datafusion:vortex-file-compressed -0.0% -0.1% +0.1% +10.0% ➖ noise
21 duckdb:duckdb -2.9% -0.1% -2.8% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +1.3% -0.1% +1.4% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +0.0% -0.0% +0.0% +14.5% ➖ noise
22 duckdb:duckdb +2.8% -0.0% +2.8% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +6.5% -0.0% +6.5% +19.5% ➖ noise
23 datafusion:vortex-file-compressed +4.2% +0.5% +3.8% +45.6% ➖ noise
23 duckdb:duckdb +2.6% +0.5% +2.2% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -14.5% +0.5% -14.9% +12.0% ✅ faster
24 datafusion:vortex-file-compressed +5.6% +3.2% +2.4% +22.9% ➖ noise
24 duckdb:duckdb -1.1% +3.2% -4.2% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -3.1% +3.2% -6.1% +32.5% ➖ noise
25 datafusion:vortex-file-compressed +3.3% +0.4% +2.9% +10.6% ➖ noise
25 duckdb:duckdb -1.3% +0.4% -1.8% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -4.7% +0.4% -5.1% +13.0% ➖ noise
26 datafusion:vortex-file-compressed +7.7% +3.6% +4.0% +10.0% ➖ noise
26 duckdb:duckdb -0.1% +3.6% -3.6% +13.0% ➖ noise
26 duckdb:vortex-file-compressed -6.4% +3.6% -9.7% +19.9% ➖ noise
27 datafusion:vortex-file-compressed +2.0% +0.7% +1.2% +10.0% ➖ noise
27 duckdb:duckdb -11.5% +0.7% -12.1% +10.0% ✅ faster
27 duckdb:vortex-file-compressed +1.0% +0.7% +0.3% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -0.9% -0.1% -0.7% +11.1% ➖ noise
28 duckdb:duckdb -1.6% -0.1% -1.4% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -0.2% -0.1% -0.1% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -3.6% -1.5% -2.1% +10.5% ➖ noise
29 duckdb:duckdb -1.6% -1.5% -0.0% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -3.4% -1.5% -1.9% +16.0% ➖ noise
30 datafusion:vortex-file-compressed -0.5% -1.3% +0.8% +10.0% ➖ noise
30 duckdb:duckdb -1.4% -1.3% -0.1% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -0.1% -1.3% +1.2% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -0.6% -2.7% +2.2% +10.0% ➖ noise
31 duckdb:duckdb -0.6% -2.7% +2.2% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +2.7% -2.7% +5.6% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +1.3% -1.4% +2.8% +10.0% ➖ noise
32 duckdb:duckdb -4.0% -1.4% -2.6% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +9.3% -1.4% +10.9% +10.0% 🚨 regression
33 datafusion:vortex-file-compressed +1.0% -1.6% +2.6% +10.0% ➖ noise
33 duckdb:duckdb -6.5% -1.6% -5.0% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +3.3% -1.6% +4.9% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +0.4% +1.1% -0.7% +10.0% ➖ noise
34 duckdb:duckdb -1.2% +1.1% -2.3% +10.4% ➖ noise
34 duckdb:vortex-file-compressed -4.5% +1.1% -5.6% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -2.1% +0.0% -2.2% +10.0% ➖ noise
35 duckdb:duckdb -1.3% +0.0% -1.3% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +2.4% +0.0% +2.4% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +0.9% -1.6% +2.6% +10.0% ➖ noise
36 duckdb:duckdb +4.5% -1.6% +6.2% +15.4% ➖ noise
36 duckdb:vortex-file-compressed +4.5% -1.6% +6.2% +10.4% ➖ noise
37 datafusion:vortex-file-compressed -0.0% -3.1% +3.2% +10.0% ➖ noise
37 duckdb:duckdb -2.6% -3.1% +0.5% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +7.8% -3.1% +11.2% +10.0% 🚨 regression
38 datafusion:vortex-file-compressed +1.2% -0.8% +2.0% +11.1% ➖ noise
38 duckdb:duckdb -3.4% -0.8% -2.7% +16.8% ➖ noise
38 duckdb:vortex-file-compressed +1.3% -0.8% +2.1% +12.8% ➖ noise
39 datafusion:vortex-file-compressed +1.4% -2.5% +4.0% +10.0% ➖ noise
39 duckdb:duckdb -1.9% -2.5% +0.5% +20.9% ➖ noise
39 duckdb:vortex-file-compressed -1.8% -2.5% +0.7% +11.3% ➖ noise
40 datafusion:vortex-file-compressed -8.9% +0.2% -9.1% +10.3% ➖ noise
40 duckdb:duckdb -3.1% +0.2% -3.3% +11.0% ➖ noise
40 duckdb:vortex-file-compressed +3.9% +0.2% +3.7% +10.2% ➖ noise
41 datafusion:vortex-file-compressed -10.7% -2.1% -8.8% +10.0% ➖ noise
41 duckdb:duckdb -5.2% -2.1% -3.2% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +5.2% -2.1% +7.4% +10.0% ➖ noise
42 datafusion:vortex-file-compressed -3.4% -0.7% -2.7% +13.5% ➖ noise
42 duckdb:duckdb -1.6% -0.7% -0.9% +13.9% ➖ noise
42 duckdb:vortex-file-compressed +4.1% -0.7% +4.8% +16.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 25, 2026

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 25, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.0%
Vortex (geomean): 0.972x ➖
Parquet (geomean): 0.972x ➖
Shifts: Parquet (control) -2.8% · Median polish -3.1%

datafusion / vortex-file-compressed (0.921x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 667348568 795094826 0.84
tpch_q02/datafusion:vortex-file-compressed 659836176 813416617 0.81
tpch_q03/datafusion:vortex-file-compressed 750673906 878015227 0.85
tpch_q04/datafusion:vortex-file-compressed 582964040 582354370 1.00
tpch_q05/datafusion:vortex-file-compressed 936097169 972158545 0.96
tpch_q06/datafusion:vortex-file-compressed 643716727 613015959 1.05
tpch_q07/datafusion:vortex-file-compressed 943506163 1061941595 0.89
tpch_q08/datafusion:vortex-file-compressed 1077113005 1257126883 0.86
tpch_q09/datafusion:vortex-file-compressed 1233243867 1337656858 0.92
tpch_q10/datafusion:vortex-file-compressed 910910210 1006521814 0.91
tpch_q11/datafusion:vortex-file-compressed 461938090 466407956 0.99
tpch_q12/datafusion:vortex-file-compressed 842969602 885040093 0.95
tpch_q13/datafusion:vortex-file-compressed 428858079 460755240 0.93
tpch_q14/datafusion:vortex-file-compressed 581599986 598454153 0.97
tpch_q15/datafusion:vortex-file-compressed 1042927498 1144164110 0.91
tpch_q16/datafusion:vortex-file-compressed 317544277 388357001 0.82
tpch_q17/datafusion:vortex-file-compressed 1114981368 1226005281 0.91
tpch_q18/datafusion:vortex-file-compressed 1188137015 1210200476 0.98
tpch_q19/datafusion:vortex-file-compressed 706044453 788665757 0.90
tpch_q20/datafusion:vortex-file-compressed 915731253 963395468 0.95
tpch_q21/datafusion:vortex-file-compressed 1600153626 1656390504 0.97
tpch_q22/datafusion:vortex-file-compressed 303804042 327558527 0.93
datafusion / vortex-compact (0.946x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 662773759 680626147 0.97
tpch_q02/datafusion:vortex-compact 630577172 599792106 1.05
tpch_q03/datafusion:vortex-compact 658949848 692278653 0.95
tpch_q04/datafusion:vortex-compact 531634033 523237791 1.02
tpch_q05/datafusion:vortex-compact 830380745 860753499 0.96
tpch_q06/datafusion:vortex-compact 526687953 576565580 0.91
tpch_q07/datafusion:vortex-compact 901395105 962620052 0.94
tpch_q08/datafusion:vortex-compact 1013514303 1095643618 0.93
tpch_q09/datafusion:vortex-compact 1127649005 1159855064 0.97
tpch_q10/datafusion:vortex-compact 814394135 1018736882 0.80
tpch_q11/datafusion:vortex-compact 372788291 514438863 0.72
tpch_q12/datafusion:vortex-compact 723216046 954401020 0.76
tpch_q13/datafusion:vortex-compact 411622559 397288183 1.04
tpch_q14/datafusion:vortex-compact 575876460 561856100 1.02
tpch_q15/datafusion:vortex-compact 1011852536 1053060658 0.96
tpch_q16/datafusion:vortex-compact 296453379 315791134 0.94
tpch_q17/datafusion:vortex-compact 1140042201 1156613602 0.99
tpch_q18/datafusion:vortex-compact 1042315126 1051447662 0.99
tpch_q19/datafusion:vortex-compact 779535356 804922346 0.97
tpch_q20/datafusion:vortex-compact 855755622 907130759 0.94
tpch_q21/datafusion:vortex-compact 1375545622 1410794774 0.98
tpch_q22/datafusion:vortex-compact 352176366 319260662 1.10
datafusion / parquet (0.984x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 730369259 656714178 1.11
tpch_q02/datafusion:parquet 612104044 685121370 0.89
tpch_q03/datafusion:parquet 874939398 914388639 0.96
tpch_q04/datafusion:parquet 467770073 421288789 1.11
tpch_q05/datafusion:parquet 1153725375 1127260718 1.02
tpch_q06/datafusion:parquet 535982591 500564497 1.07
tpch_q07/datafusion:parquet 1418047303 1171184611 1.21
tpch_q08/datafusion:parquet 1673341345 1473629553 1.14
tpch_q09/datafusion:parquet 1812622540 1663127792 1.09
tpch_q10/datafusion:parquet 1910825291 2026399616 0.94
tpch_q11/datafusion:parquet 457793434 472406006 0.97
tpch_q12/datafusion:parquet 591106119 586573965 1.01
tpch_q13/datafusion:parquet 687574156 707063353 0.97
tpch_q14/datafusion:parquet 767607823 760889023 1.01
tpch_q15/datafusion:parquet 1163099242 1222954151 0.95
tpch_q16/datafusion:parquet 328044799 355932629 0.92
tpch_q17/datafusion:parquet 1310808271 1434677188 0.91
tpch_q18/datafusion:parquet 1349311702 1642338492 0.82
tpch_q19/datafusion:parquet 929824276 1103543462 0.84
tpch_q20/datafusion:parquet 1066072477 1207030737 0.88
tpch_q21/datafusion:parquet 1629110960 1661748163 0.98
tpch_q22/datafusion:parquet 634447846 676003968 0.94
duckdb / vortex-file-compressed (1.015x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 618277646 618372015 1.00
tpch_q02/duckdb:vortex-file-compressed 1093645695 1150313605 0.95
tpch_q03/duckdb:vortex-file-compressed 908704443 910036922 1.00
tpch_q04/duckdb:vortex-file-compressed 638969921 621707238 1.03
tpch_q05/duckdb:vortex-file-compressed 1108638177 1040453200 1.07
tpch_q06/duckdb:vortex-file-compressed 811158123 729473164 1.11
tpch_q07/duckdb:vortex-file-compressed 1110406119 1159788081 0.96
tpch_q08/duckdb:vortex-file-compressed 1397600697 1430151445 0.98
tpch_q09/duckdb:vortex-file-compressed 1505082186 1347253570 1.12
tpch_q10/duckdb:vortex-file-compressed 1075067807 1071208144 1.00
tpch_q11/duckdb:vortex-file-compressed 621235723 607088551 1.02
tpch_q12/duckdb:vortex-file-compressed 706202602 685086780 1.03
tpch_q13/duckdb:vortex-file-compressed 859996283 867481869 0.99
tpch_q14/duckdb:vortex-file-compressed 824547558 840256743 0.98
tpch_q15/duckdb:vortex-file-compressed 528054424 526457676 1.00
tpch_q16/duckdb:vortex-file-compressed 472901825 485403419 0.97
tpch_q17/duckdb:vortex-file-compressed 988001668 971712446 1.02
tpch_q18/duckdb:vortex-file-compressed 892634027 903224818 0.99
tpch_q19/duckdb:vortex-file-compressed 791173645 750162719 1.05
tpch_q20/duckdb:vortex-file-compressed 1256381609 1193454364 1.05
tpch_q21/duckdb:vortex-file-compressed 1896563014 1860237389 1.02
tpch_q22/duckdb:vortex-file-compressed 579779076 573684182 1.01
duckdb / vortex-compact (1.011x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 641133411 591020549 1.08
tpch_q02/duckdb:vortex-compact 976321388 977169480 1.00
tpch_q03/duckdb:vortex-compact 787265734 794711503 0.99
tpch_q04/duckdb:vortex-compact 466410805 479712006 0.97
tpch_q05/duckdb:vortex-compact 1018915018 1003598255 1.02
tpch_q06/duckdb:vortex-compact 739997248 707061618 1.05
tpch_q07/duckdb:vortex-compact 1073200658 1019674133 1.05
tpch_q08/duckdb:vortex-compact 1323499368 1288643925 1.03
tpch_q09/duckdb:vortex-compact 1260191201 1284773606 0.98
tpch_q10/duckdb:vortex-compact 943295698 1017948758 0.93
tpch_q11/duckdb:vortex-compact 637608311 620781273 1.03
tpch_q12/duckdb:vortex-compact 726006418 633591620 1.15
tpch_q13/duckdb:vortex-compact 864440236 829720085 1.04
tpch_q14/duckdb:vortex-compact 779754678 778101759 1.00
tpch_q15/duckdb:vortex-compact 521668133 519309892 1.00
tpch_q16/duckdb:vortex-compact 446923646 420468429 1.06
tpch_q17/duckdb:vortex-compact 870211845 859743107 1.01
tpch_q18/duckdb:vortex-compact 680647664 769140064 0.88
tpch_q19/duckdb:vortex-compact 712080416 693856669 1.03
tpch_q20/duckdb:vortex-compact 1110220762 1093784583 1.02
tpch_q21/duckdb:vortex-compact 1528828978 1608800073 0.95
tpch_q22/duckdb:vortex-compact 583791582 581475909 1.00
duckdb / parquet (0.960x ➖, 0↑ 0↓)
name PR ca6942f (ns) base 1838a7a (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 754798737 750777245 1.01
tpch_q02/duckdb:parquet 1373412732 1519432251 0.90
tpch_q03/duckdb:parquet 1491174852 1493924879 1.00
tpch_q04/duckdb:parquet 806891472 888979807 0.91
tpch_q05/duckdb:parquet 1856524782 1989469815 0.93
tpch_q06/duckdb:parquet 658994471 729071335 0.90
tpch_q07/duckdb:parquet 1656842728 1839915401 0.90
tpch_q08/duckdb:parquet 2258212298 2315774167 0.98
tpch_q09/duckdb:parquet 2416195303 2374922690 1.02
tpch_q10/duckdb:parquet 2860818541 2994521696 0.96
tpch_q11/duckdb:parquet 946345308 1016113095 0.93
tpch_q12/duckdb:parquet 939793500 1069244619 0.88
tpch_q13/duckdb:parquet 1152073984 1177230306 0.98
tpch_q14/duckdb:parquet 1127186519 1214413475 0.93
tpch_q15/duckdb:parquet 869577600 799288466 1.09
tpch_q16/duckdb:parquet 812326261 846492235 0.96
tpch_q17/duckdb:parquet 1229606528 1299912775 0.95
tpch_q18/duckdb:parquet 1213950787 1289167636 0.94
tpch_q19/duckdb:parquet 1392290458 1434300697 0.97
tpch_q20/duckdb:parquet 1623545212 1733451780 0.94
tpch_q21/duckdb:parquet 1803897133 1779333830 1.01
tpch_q22/duckdb:parquet 1110537429 1025048687 1.08
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -2.6% +5.7% -7.9% +30.8% ➖ noise
1 datafusion:vortex-file-compressed -16.1% +5.7% -20.6% +38.1% ➖ noise
1 duckdb:vortex-compact +8.5% +5.7% +2.6% +106.1% ➖ noise
1 duckdb:vortex-file-compressed -0.0% +5.7% -5.4% +30.0% ➖ noise
2 datafusion:vortex-compact +5.1% -10.1% +17.0% +42.6% ➖ noise
2 datafusion:vortex-file-compressed -18.9% -10.1% -9.7% +34.3% ➖ noise
2 duckdb:vortex-compact -0.1% -10.1% +11.2% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -4.9% -10.1% +5.8% +30.0% ➖ noise
3 datafusion:vortex-compact -4.8% -2.3% -2.6% +37.2% ➖ noise
3 datafusion:vortex-file-compressed -14.5% -2.3% -12.5% +39.9% ➖ noise
3 duckdb:vortex-compact -0.9% -2.3% +1.4% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -0.1% -2.3% +2.2% +32.7% ➖ noise
4 datafusion:vortex-compact +1.6% +0.4% +1.2% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +0.1% +0.4% -0.3% +30.0% ➖ noise
4 duckdb:vortex-compact -2.8% +0.4% -3.1% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +2.8% +0.4% +2.4% +30.0% ➖ noise
5 datafusion:vortex-compact -3.5% -2.3% -1.3% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -3.7% -2.3% -1.5% +30.0% ➖ noise
5 duckdb:vortex-compact +1.5% -2.3% +3.9% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +6.6% -2.3% +9.0% +30.0% ➖ noise
6 datafusion:vortex-compact -8.7% -1.6% -7.1% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +5.0% -1.6% +6.7% +30.0% ➖ noise
6 duckdb:vortex-compact +4.7% -1.6% +6.4% +85.1% ➖ noise
6 duckdb:vortex-file-compressed +11.2% -1.6% +13.0% +30.0% ➖ noise
7 datafusion:vortex-compact -6.4% +4.4% -10.3% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -11.2% +4.4% -14.9% +30.0% ➖ noise
7 duckdb:vortex-compact +5.2% +4.4% +0.8% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -4.3% +4.4% -8.3% +30.0% ➖ noise
8 datafusion:vortex-compact -7.5% +5.2% -12.1% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -14.3% +5.2% -18.6% +30.0% ➖ noise
8 duckdb:vortex-compact +2.7% +5.2% -2.4% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -2.3% +5.2% -7.1% +30.0% ➖ noise
9 datafusion:vortex-compact -2.8% +5.3% -7.7% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -7.8% +5.3% -12.4% +30.0% ➖ noise
9 duckdb:vortex-compact -1.9% +5.3% -6.9% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +11.7% +5.3% +6.1% +30.0% ➖ noise
10 datafusion:vortex-compact -20.1% -5.1% -15.8% +30.0% ➖ noise
10 datafusion:vortex-file-compressed -9.5% -5.1% -4.6% +30.0% ➖ noise
10 duckdb:vortex-compact -7.3% -5.1% -2.4% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +0.4% -5.1% +5.7% +30.0% ➖ noise
11 datafusion:vortex-compact -27.5% -5.0% -23.7% +30.0% ✅ faster
11 datafusion:vortex-file-compressed -1.0% -5.0% +4.3% +30.0% ➖ noise
11 duckdb:vortex-compact +2.7% -5.0% +8.1% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +2.3% -5.0% +7.7% +30.0% ➖ noise
12 datafusion:vortex-compact -24.2% -5.9% -19.5% +30.0% ➖ noise
12 datafusion:vortex-file-compressed -4.8% -5.9% +1.2% +30.0% ➖ noise
12 duckdb:vortex-compact +14.6% -5.9% +21.8% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +3.1% -5.9% +9.5% +30.0% ➖ noise
13 datafusion:vortex-compact +3.6% -2.4% +6.2% +30.0% ➖ noise
13 datafusion:vortex-file-compressed -6.9% -2.4% -4.6% +30.0% ➖ noise
13 duckdb:vortex-compact +4.2% -2.4% +6.8% +32.8% ➖ noise
13 duckdb:vortex-file-compressed -0.9% -2.4% +1.6% +38.3% ➖ noise
14 datafusion:vortex-compact +2.5% -3.2% +5.9% +30.0% ➖ noise
14 datafusion:vortex-file-compressed -2.8% -3.2% +0.4% +30.0% ➖ noise
14 duckdb:vortex-compact +0.2% -3.2% +3.6% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -1.9% -3.2% +1.4% +30.0% ➖ noise
15 datafusion:vortex-compact -3.9% +1.7% -5.5% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -8.8% +1.7% -10.4% +30.0% ➖ noise
15 duckdb:vortex-compact +0.5% +1.7% -1.2% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +0.3% +1.7% -1.4% +108.2% ➖ noise
16 datafusion:vortex-compact -6.1% -6.0% -0.2% +30.0% ➖ noise
16 datafusion:vortex-file-compressed -18.2% -6.0% -13.1% +30.0% ➖ noise
16 duckdb:vortex-compact +6.3% -6.0% +13.0% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -2.6% -6.0% +3.6% +30.0% ➖ noise
17 datafusion:vortex-compact -1.4% -7.0% +6.0% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -9.1% -7.0% -2.2% +30.0% ➖ noise
17 duckdb:vortex-compact +1.2% -7.0% +8.9% +49.5% ➖ noise
17 duckdb:vortex-file-compressed +1.7% -7.0% +9.4% +30.0% ➖ noise
18 datafusion:vortex-compact -0.9% -12.0% +12.7% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -1.8% -12.0% +11.6% +30.0% ➖ noise
18 duckdb:vortex-compact -11.5% -12.0% +0.6% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -1.2% -12.0% +12.4% +30.0% ➖ noise
19 datafusion:vortex-compact -3.2% -9.6% +7.1% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -10.5% -9.6% -1.0% +30.0% ➖ noise
19 duckdb:vortex-compact +2.6% -9.6% +13.5% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +5.5% -9.6% +16.6% +30.0% ➖ noise
20 datafusion:vortex-compact -5.7% -9.0% +3.7% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -4.9% -9.0% +4.5% +30.0% ➖ noise
20 duckdb:vortex-compact +1.5% -9.0% +11.6% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +5.3% -9.0% +15.7% +30.0% ➖ noise
21 datafusion:vortex-compact -2.5% -0.3% -2.2% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -3.4% -0.3% -3.1% +30.0% ➖ noise
21 duckdb:vortex-compact -5.0% -0.3% -4.7% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +2.0% -0.3% +2.3% +30.0% ➖ noise
22 datafusion:vortex-compact +10.3% +0.8% +9.4% +30.0% ➖ noise
22 datafusion:vortex-file-compressed -7.3% +0.8% -8.0% +30.0% ➖ noise
22 duckdb:vortex-compact +0.4% +0.8% -0.4% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +1.1% +0.8% +0.2% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 10, 2026

This PR has been marked as stale because it has been open for 14 days with no activity. Please comment or remove the stale label if you wish to keep it active, otherwise it will be closed in 7 days

@github-actions github-actions Bot added the stale This PR is stale and will be auto-closed soon label May 10, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

changelog/performance A performance improvement ext/datafusion Relates to the DataFusion integration stale This PR is stale and will be auto-closed soon

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@AdamGS